Instruction-Tuning-with-GPT-4/GPT-4-LLM resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4334 stars · 307 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

A research dataset release of GPT-4-generated instruction-following data for fine-tuning large language models, including English and Chinese instruction data, comparison data for reward model training, and answers on Unnatural Instructions. It accompanies the paper 'Instruction Tuning with GPT-4' and includes code for evaluation and reproducing figure plots.

Use cases

• fine-tune llama with gpt-4 generated instruction data
• get chinese instruction following dataset for llm training
• train a reward model with gpt-4 comparison rankings
• build an instruction-following chatbot like alpaca
• evaluate instruction-tuned models against gpt-4 answers
• download alpaca prompts with gpt-4 responses

When to choose

• you need supervised fine-tuning data for instruction-following LLMs
• you want Chinese-language instruction tuning data
• you need ranked comparison data to train reward models for RLHF
• you are doing non-commercial LLM research

When to avoid

• you need production or commercial-use licensed data (CC BY NC 4.0 restricts to research)
• you need up-to-date data or active maintenance (last release 2023)
• you want a ready-to-use trained model rather than datasets
• you need multimodal or vision instruction data (see LLaVA instead)

Facets

dataset · maturity maintenance

machine-learning llm-training data-generation large-language-models machine-learning artificial-intelligence python cross-platform instruction-tuning gpt-4 alpaca llama fine-tuning-data reward-model chinese-nlp research-dataset

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Instruction-Tuning-with-GPT-4/GPT-4-LLM")