Collection by
May 8, 2025
Collections
Discover the best community collections!
Collections including paper arxiv:2309.06657
Collection by
Jun 8, 2024
-
Attention Is All You Need
Paper • 1706.03762 • Published • 112 -
Language Models are Few-Shot Learners
Paper • 2005.14165 • Published • 19 -
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 6 -
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper • 2307.09288 • Published • 250
Collection by
Oct 7, 2023
-
Efficient RLHF: Reducing the Memory Usage of PPO
Paper • 2309.00754 • Published • 16 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Aligning Large Multimodal Models with Factually Augmented RLHF
Paper • 2309.14525 • Published • 32 -
Stabilizing RLHF through Advantage Model and Selective Rehearsal
Paper • 2309.10202 • Published • 11
Collection by
Sep 20, 2023
Collection by
Oct 27, 2023
-
Efficient RLHF: Reducing the Memory Usage of PPO
Paper • 2309.00754 • Published • 16 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Paper • 2309.07462 • Published • 4 -
Stabilizing RLHF through Advantage Model and Selective Rehearsal
Paper • 2309.10202 • Published • 11
Collection by
Oct 13, 2024
-
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 64 -
Towards Efficient and Exact Optimization of Language Model Alignment
Paper • 2402.00856 • Published • 1 -
A General Theoretical Paradigm to Understand Learning from Human Preferences
Paper • 2310.12036 • Published • 19 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15
Collection by
Jan 15
-
Moral Foundations of Large Language Models
Paper • 2310.15337 • Published • 1 -
Specific versus General Principles for Constitutional AI
Paper • 2310.13798 • Published • 3 -
Contrastive Prefence Learning: Learning from Human Feedback without RL
Paper • 2310.13639 • Published • 25 -
RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback
Paper • 2309.00267 • Published • 53
Collection by
Sep 25, 2023
-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84 -
Baichuan 2: Open Large-scale Language Models
Paper • 2309.10305 • Published • 22 -
Chain-of-Verification Reduces Hallucination in Large Language Models
Paper • 2309.11495 • Published • 40 -
LMDX: Language Model-based Document Information Extraction and Localization
Paper • 2309.10952 • Published • 67
Collection by
May 12, 2025
-
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
In-Context Learning Creates Task Vectors
Paper • 2310.15916 • Published • 44 -
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper • 2404.08801 • Published • 66 -
Make Your LLM Fully Utilize the Context
Paper • 2404.16811 • Published • 55
Collection by
Sep 2, 2024
-
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Efficient Monotonic Multihead Attention
Paper • 2312.04515 • Published • 8 -
Layerwise Recurrent Router for Mixture-of-Experts
Paper • 2408.06793 • Published • 32 -
Scaling Up Diffusion and Flow-based XGBoost Models
Paper • 2408.16046 • Published • 10
Collection by
May 8, 2025
Collection by
Oct 13, 2024
-
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 64 -
Towards Efficient and Exact Optimization of Language Model Alignment
Paper • 2402.00856 • Published • 1 -
A General Theoretical Paradigm to Understand Learning from Human Preferences
Paper • 2310.12036 • Published • 19 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15
Collection by
Jun 8, 2024
-
Attention Is All You Need
Paper • 1706.03762 • Published • 112 -
Language Models are Few-Shot Learners
Paper • 2005.14165 • Published • 19 -
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 6 -
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper • 2307.09288 • Published • 250
Collection by
Jan 15
-
Moral Foundations of Large Language Models
Paper • 2310.15337 • Published • 1 -
Specific versus General Principles for Constitutional AI
Paper • 2310.13798 • Published • 3 -
Contrastive Prefence Learning: Learning from Human Feedback without RL
Paper • 2310.13639 • Published • 25 -
RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback
Paper • 2309.00267 • Published • 53
Collection by
Oct 7, 2023
-
Efficient RLHF: Reducing the Memory Usage of PPO
Paper • 2309.00754 • Published • 16 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Aligning Large Multimodal Models with Factually Augmented RLHF
Paper • 2309.14525 • Published • 32 -
Stabilizing RLHF through Advantage Model and Selective Rehearsal
Paper • 2309.10202 • Published • 11
Collection by
Sep 25, 2023
-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84 -
Baichuan 2: Open Large-scale Language Models
Paper • 2309.10305 • Published • 22 -
Chain-of-Verification Reduces Hallucination in Large Language Models
Paper • 2309.11495 • Published • 40 -
LMDX: Language Model-based Document Information Extraction and Localization
Paper • 2309.10952 • Published • 67
Collection by
Sep 20, 2023
Collection by
May 12, 2025
-
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
In-Context Learning Creates Task Vectors
Paper • 2310.15916 • Published • 44 -
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper • 2404.08801 • Published • 66 -
Make Your LLM Fully Utilize the Context
Paper • 2404.16811 • Published • 55
Collection by
Oct 27, 2023
-
Efficient RLHF: Reducing the Memory Usage of PPO
Paper • 2309.00754 • Published • 16 -
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Paper • 2309.07462 • Published • 4 -
Stabilizing RLHF through Advantage Model and Selective Rehearsal
Paper • 2309.10202 • Published • 11
Collection by
Sep 2, 2024
-
Statistical Rejection Sampling Improves Preference Optimization
Paper • 2309.06657 • Published • 15 -
Efficient Monotonic Multihead Attention
Paper • 2312.04515 • Published • 8 -
Layerwise Recurrent Router for Mixture-of-Experts
Paper • 2408.06793 • Published • 32 -
Scaling Up Diffusion and Flow-based XGBoost Models
Paper • 2408.16046 • Published • 10