Shortcuts
HTMS: hooklee's Research Pointer, Sci-Journals and Sci-Conferences (hooklee's Calendar of CFPs), Sci-Services, Organizations
General AI
AI Safety and Transparency including Explainable AI (XAI):
Foundation Model Transparency Index (FMTI)
Fair-LLM-Benchmark ("Bias and Fairness in Large Language Models: A Survey" 2024)
Aequitas: Bias Auditing & "Correction" Toolkit
AI Fairness 360 (AIF360)
(KDD 2023 Tutorial)
Data and code of the paper "Dissecting racial bias in an algorithm used to manage the health of populations" (Science Magazine 2019)
(XAITK-Saliency)
XNLP: XAI for Natural Language Processing
(GitHub,
Analysis360: Open Implementations of LLM Analyses)
AI+GUI: UI-TARS: Pioneering Automated GUI Interaction with Native Agents (2025) UI-TARS Desktop (2025)
AI Art Generators:
AIGCBench
Ziqi Huang's Awesome Evaluation of Visual Generation
Open AI's DALL·E 2
Bing Image Creator
Stability AI
(Stable Diffusion,
Visual ChatGPT)
Midjourney
Dream by WOMBO
Natural Language Processing and Computational Linguistics
LLMs:
🤗 Open LLM Leaderboard
LLM-Leaderboard (community-based)
Hannibal046's Awesome-LLM
Awesome Machine Generated Text
A Survey on Language, Multimodal, and Scientific GPT Models: Examing User-Friendly and Open-Sourced Large GPT Models
Prompt Engineering Guide
AI Alignment: A Comprehensive Survey (PKU 2023-)
Min Woo (Daniel) Park's Open-LLM-datasets
PleIAs's Common Corpus
PleIAs's OpenCulture
PleIAs's Toxic Commons
PleIAs's Finance Commons
Awesome-Medical-Healthcare-Dataset-For-LLM
(GitHub)
Awesome papers on LLMs detection
BUST: Benchmark for the Evaluation of System Detectors of LLM-Generated Text (NAACL 2024)
A Survey of Attributions for Large Language Models (2023)
Factcheck-GPT (2023)
DetectGPT (2022)
LMs+Cyber Security and Safety: Thomas Roccia's Awesome GPTs (Agents) for Cybersecurity CyberAlbSecOP's Awesome_GPT_Super_Prompting
Zhenhong Zhou's Awesome LLM-SafetyJensen Liu's Awesome-LLM4Security
cckuailong's Awesome GPT + Security
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
(GitHub)
NVIDIA's garak (LLM vulnerability scanner)
LLM Hacker's Handbook (Forces Unseen)
GPTSecurity.info (中文)
Conversational AI groups from Tsinghua University's AISafetyLab
Benchmarking Benchmark Leakage in Large Langauge Models
H-CoT + Malicious-Educator Benchmark (arXiv.org 2025)
SafetyPrompts.com: A Living Catalogue of Open Datasets for LLM Safety (arXiv.org 2024-25)
Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey (arXiv.org 2024-25)
LLM Conversation Safety (NAACL 2024)
When LLMs Meet Cybersecurity: A Systematic Literature Review (Cybersecurity 2024)
Malla: Demystifying Real-world Large Language Model Integrated Malicious Services (USENIX Security 2024)
OpenRedTeaming (arXiv.org 2024)
(Safety Datasets used in LibrAI Leaderboard)
HarmBench (arXiv.org 2024)
JailbreakZoo (arXiv.org 2024)
CySecBERT (ACMTOPS 2024)
CyBERTuned (NAACL Findings 2024)
HackAPrompt (EMNLP 2023)
BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset (NeurIPS 2023)
Evaluation: SemEval: International Workshop on Semantic Evaluation
General Tools: NLTK (Natural Language Toolkit)
spaCy
(
)
(GitHub)
Natural
CogCompNLP
Hugging Face
(datasets;
Write With Transformer)
Talk to Transformer (InferKit online demo)
quanteda: Quantitative Analysis of Textual Data in R
(GitHub)
gensim – Topic Modelling in Python
RNNTagger
TreeTagger
Python Word Segmentation
Word Ninja
SymSpell
(Python port: symspellpy)
Language Style Transfer (NIPS 2017)
GeoTxt (Transactions in GIS 2019)
Edinburgh Geoparser
GeoPy
XAI for Natural Language Processing (AACL-IJCNLP 2020)
Google's BERT
(GitHub)
(WuDaoCorpora;
GitHub,
GLM,
CLM;
BMInf)
BERTective (EACL 2021)
mauve-experiments (NeurIPS 2021)
Chinese NLP Resources: 预训练模型仓库 百度ERNIE Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab (鹏程.盘古α / PanGu-α)
awesome-chinese-nlp (Guan Wang)
“结巴”中文分词
THUAIPoet (九歌) research group
(九歌V2.0;
BERT-CCPoem,
MixPoet @ AAAI 2020,
Stylistic Poetry @ EMNLP 2018,
WMPoetry @ IJCAI 2018;
中国古典诗歌匹配数据集 / CCPM = Chinese Classical Poetry Matching Dataset,
Other datasets)
少女诗人小冰
tensorflow_poems / LiBai AI Composer / 中文古诗自动作诗机器人
中文语料小数据
Datasets: Nicolas Iderhoff's nlp-datasets WordNet Wikimedia Downloads
(Frequency lists)
WordNet
Amazon MASSIVE dataset
WebNLG Challenge
Wiktextract
(data @ kaikki.org)
Use of corpora in translation studies @ Centre for Translation Studies, University of Leeds
OpenLexicon
Lexique
(WorldLex: Blog, Twitter and Newspapers Word Frequencies for 66 languages)
Datasets of Automatic Keyphrase Extraction @ LIAAD, INESCTEC
KPTimes Corpus @ INLG 2019
dewiki-wordrank
OAGSX Title Generation Dataset
OAGKX Keyword Generation Dataset
GeoNames
Awesome LLM-generated Text Detection (2023)
Awesome papers on LLMs detection (2023)
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection (2023)
Privacy-related resources:
(PrivaSeer Corpus @ ACL 2021,
PrivBERT @ ACL 2021)
Federated Learning
General Resources:
Awesome-Federated-Learning
The Federated Learning Portal
Open-source Tools: TensorFlow Federated (TFF) (GitHub) NVIDIA Clara FedML: A Research Library and Benchmark for Federated Machine Learning
(GitHub)
(Federated Learning Research at Webank AI)
Commercial Solutions:
