kth8 / Llama-3.2-1B-Instruct-SuperGPQA-Classifier

A fine-tune of unsloth/Llama-3.2-1B-Instruct on the m-a-p/SuperGPQA dataset.

Usage example

System prompt

You are a classifier. Categorize the following problem into discipline, field, and subfield in JSON format.

User prompt

Cotton and linen both readily catch fire. A batch of towels is composed of both cotton and linen, and is known to have caught fire. If it is known that the towels were ignited by a lit cigarette, which of the following arguments utilizes the most appropriate form of reasoning?

Assistant response

{"discipline": "Philosophy", "field": "Philosophy", "subfield": "Logic"}

Possible output options

Discipline

['Management', 'Philosophy', 'History', 'Engineering', 'Medicine', 'Literature and Arts', 'Economics', 'Science', 'Sociology', 'Agronomy', 'Education', 'Law', 'Military Science']

Field

['Geological Resources and Geological Engineering', 'Control Science and Engineering', 'Animal Husbandry', 'Chemistry', 'Agricultural Engineering', 'Veterinary Medicine', 'Systems Science', 'Petroleum and Natural Gas Engineering', 'Geography', 'Weapon Science and Technology', 'Surveying and Mapping Science and Technology', 'Atmospheric Science', 'Architecture', 'Transportation Engineering', 'Nuclear Science and Technology', 'Forestry Engineering', 'Business Administration', 'Optical Engineering', 'Traditional Chinese Medicine', 'Musicology', 'Philosophy', 'Electronic Science and Technology', 'Physical Education', 'Language and Literature', 'Library, Information and Archival Management', 'Electrical Engineering', 'Art Studies', 'Civil Engineering', 'Stomatology', 'Crop Science', 'Instrument Science and Technology', 'Sociology', 'Education', 'Chemical Engineering and Technology', 'Aquaculture', 'Clinical Medicine', 'Computer Science and Technology', 'Physics', 'Aeronautical and Astronautical Science and Technology', 'Military Science', 'Mechanics', 'Environmental Science and Engineering', 'Food Science and Engineering', 'Management Science and Engineering', 'Psychology', 'History', 'Mining Engineering', 'Power Engineering and Engineering Thermophysics', 'Hydraulic Engineering', 'Mechanical Engineering', 'Physical Oceanography', 'Applied Economics', 'Metallurgical Engineering', 'Mathematics', 'Political Science', 'Basic Medicine', 'Geophysics', 'Public Administration', 'Geology', 'Forestry', 'Oceanography', 'Theoretical Economics', 'Journalism and Communication', 'Textile Science and Engineering', 'Information and Communication Engineering', 'Materials Science and Engineering', 'Biology', 'Naval Architecture and Ocean Engineering', 'Public Health and Preventive Medicine', 'Law', 'Pharmacy', 'Astronomy']

Subfield

['Mineral Processing Engineering', 'Labor Economics', 'Instrumentation and Performance', 'Otorhinolaryngology', 'Analytical Chemistry', 'Guidance, Navigation and Control', 'Linguistics and Applied Linguistics', 'Military Command and Information Systems', 'Mining and Safety Engineering', 'Forest Cultivation and Genetic Breeding', 'Obstetrics and Gynecology', 'Physical Chemistry', 'Signal and Information Processing', 'Marine Engineering', 'Nutrition and Food Hygiene', 'Theoretical Mechanics', 'Education Economics, Management and Social Security', 'Transportation Planning and Management', 'Quantitative Economics', 'Atomic and Molecular Physics', 'Fundamental Mathematics', 'Imaging and Nuclear Medicine', 'Subatomic and Atomic Physics', 'Rigid Body Mechanics', 'Electrodynamics', 'Crop Science', 'Radiochemistry', 'Group Theory', 'National and Defense Economics', 'Civil and Commercial Law', 'Logic', 'Internal Combustion Engineering', 'Aquaculture', 'Sports Science and Medicine', 'Dance Studies', 'Aeronautical and Astronautical Science and Technology', 'Ordinary Differential Equations', 'Materials Physics and Chemistry', 'Educational Technology and Principles', 'Theoretical Optics', 'Physical Chemistry of Metallurgical Process', 'Solid Mechanics', 'Urban Planning and Design', 'Botany', 'Databases', 'Wood Science and Technology', 'Maternal, Child and Adolescent Health', 'Atmospheric Physics and Atmospheric Environment', 'Literary History', 'Polynomials and Series Expansions', 'Constitutional and Administrative Law', 'Political Science', 'Discrete Mathematics', 'Vehicle Operation Engineering', 'Fluid Machinery and Engineering', 'Harmony', 'Philosophy of Science and Technology', 'Functions of Complex Variables', 'Electrochemistry', 'Internal Medicine', 'Statistical Mechanics', 'Pathogen Biology', 'Hydrogeology', 'Agricultural Mechanization Engineering', 'Fundamentals of Dynamics and Control', 'Clinical Stomatology', 'Antenna and Radio Communication', 'Military Management', 'Electrical Theory and New Technologies', 'Power Systems and Automation', 'Food Biochemistry', 'Formal Languages', 'Water conservancy and Hydropower Engineering', 'Legal Theory and Legal History', 'Optical Fiber Communication', 'Astrophysics', 'Contract Law', 'Preschool Education', 'Power Machinery and Engineering', 'Advanced Programming Languages', 'Principles of Metallurgy', 'Astronomical Observation and Technology', 'Physiology', 'Advanced Algebra', 'Economic Statistics', 'Veterinary Medicine', 'Anesthesiology', 'Psychiatry and Mental Health', 'Military Logistics and Equipment', 'Electromagnetic Field and Microwave Technology', 'Music History, Education, and Technology', 'Meteorology', 'Engineering Fluid Mechanics', 'Road and Railway Engineering', 'Composition', 'Forensic Medicine', 'Geotechnical Engineering', 'Pitch and Scales', 'Environmental and Resource Protection', 'Historical Geography', 'Communication Principles', 'Dynamic Meteorology', 'Mechatronic Engineering', 'Environmental Science', 'Theoretical Fluid Mechanics', 'Circuits and Systems', 'Archaeology and Museology', 'Geriatric Medicine', 'Land Resource Management and Administrative Management', 'Weapon Systems Science and Engineering', 'Marine Biology', 'Particle and Nuclear Physics', 'Biochemistry and Molecular Biology', 'Procedural Law', 'High Voltage and Insulation Technology', 'Philology and Bibliography', 'Design Arts', 'Optoelectronic Technology', 'Poromechanics and Reservoir Physics', 'Engineering Thermophysics', 'Broadcasting and Television Art', 'Library and Archival Science', 'Ethics', 'Physical Oceanography', 'Solar System Science', 'Thermal Energy Engineering', 'Fuzzy Mathematics', 'Agricultural Environment and Soil-Water Engineering', 'Cartography and Geographic Information Engineering', 'Genetics', 'Chemical Transport Engineering', 'Film Studies', 'Information Management Science', 'Architectural Design and Theory', 'Pharmacology', 'Computer Software and Theory', 'Inorganic Chemistry', 'Microbiology', 'Philosophical Aesthetics', 'Non-ferrous Metallurgy', 'Stellar and Interstellar Evolution', 'Computer Networks', 'Marine Chemistry', 'Thermodynamics and Statistical Physics', 'Operating Systems', 'Elements of Chemical Reaction Engineering', 'Thermodynamics', 'Literary Theory', 'Musical Forms and Analysis', 'Traditional Chinese Health Preservation', 'Geological Resources and Geological Engineering', 'Surgery', 'Operations Research and Cybernetics', 'Journalism and News Practice', 'Drama and Opera Studies', 'Human Geography', 'Systems Science', 'Industrial Economics', 'Organic Chemistry', 'Social and Folklore Studies', 'Bridge and Tunnel Engineering', 'Military Chemistry and Pyrotechnics', 'Principles of Seismic Exploration', 'Landscape Plants and Ornamental Horticulture', 'Communication and Information Systems', 'Traditional Chinese Pharmacy', 'Finance', 'Computational Mathematics', 'History and Theory of Journalism and Media Management', 'Emergency Medicine', 'Digital Surveying and Remote Sensing Applications', 'Quantum Mechanics', 'Nuclear Energy and Reactor Technology', 'Mathematical Analysis', 'Biophysics', 'Microelectronics and Solid-State Electronics', 'International Law', 'Mass Transport and Separation Process in Chemical Engineering', 'Medicinal Chemistry', 'Physical Education and Training', 'Forest Engineering', 'Instrument Science and Technology', 'Laser Technology', 'Information Management and Communication', 'Russian Language and Literature', 'Theory of Curriculum and Instruction', 'Power Electronics and Electrical Drives', 'Cryptography', 'Communication and Broadcasting', 'Functions of Real Variables', 'International Trade', 'Materials Processing Engineering', 'Economic History', 'Traffic Information Engineering and Control', 'Textile Chemistry and Dyeing Engineering', 'Urban Infrastructure Engineering', 'Semiconductor Physics', 'Ship Mechanics and Design Principles', 'Neurology', 'Immunology', 'Ophthalmology', 'Ecology', 'Heat Transfer', 'Graph Theory', 'Epidemiology and Health Statistics', 'Military Thought and History', 'Radiation Protection and Nuclear Technology Applications', 'Computer Architecture', 'Control Theory and Control Engineering', 'Polymer Physics', 'Underwater Acoustics', 'Nursing and Rehabilitation Medicine', 'Radiation Medicine', 'Geochemistry', 'Traditional Chinese Medicine Theory', 'Oncology', 'Physical Geography', 'Tourism Management and Technological Economics Management', 'Number Theory', 'Social Medicine and Health Management', 'Pediatrics', 'French Language and Literature', 'Demography and Anthropology', 'Oil and Gas Field Development and Storage & Transportation Engineering', 'Zoology', 'Sports Humanities and Sociology', 'Architectural History', 'Environmental Engineering', 'Paleontology and Stratigraphy', 'Space physics', 'Public Finance', 'Structural Geology', 'Combinatorial Mathematics', 'Applied Optics', 'Food Processing and Storage Engineering', 'Iron and Steel Metallurgy', 'Fluid Physics', 'Hydraulics and Hydrology', 'World History', 'Classical Chinese Literature', 'Solid State Physics', 'Textile Materials Science', 'Dermatology and Venereology', 'Geometry and Topology', 'Data Structures', 'Military Law', 'Health Toxicology and Environmental Health', 'Religious Studies', 'Management Science and Engineering', 'Relativity', 'Psychology', 'Criminal Law', 'Refrigeration and Cryogenic Engineering', 'Political Economy', 'Stochastic Processes', 'Clinical Laboratory Diagnostics', 'Cell Biology', 'Modern and Contemporary Chinese Literature', 'Western Economics', 'Basic Stomatology', 'Solid Earth Geophysics', 'Geodesy and Surveying Engineering', 'Microbiology and Biochemical Pharmacy', 'Pattern Recognition', 'Animal Rearing and Breeding', 'Polymer Chemistry and Physics', 'Acoustics', 'Business and Accounting Management', 'Fluid Flow and Heat Transfer in Chemical Engineering', 'Cosmology', 'Mineralogy, Petrology, and Economic Geology', 'Special Education', 'Principles of Computer Organization', 'Fine Arts', 'Structural Engineering', 'Pharmaceutical Analysis', 'Probability and Statistics', 'Special Number Theory', 'Animal Nutrition and Feed Science', 'Pharmaceutics', 'Manufacturing Automation', 'Human Anatomy and Histology-Embryology', 'Law and Social Governance', 'Pathology and Pathophysiology', 'Numerical Analysis']

Model Details

• Base Model: unsloth/Llama-3.2-1B-Instruct
• Parameter Count: 1235814400
• Precision: torch.bfloat16

Training Settings

Hardware

• GPU: NVIDIA A100-SXM4-40GB

PEFT

• Rank: 32
• LoRA alpha: 64
• Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj

SFT

• Epoch: 2
• Batch size: 16
• Gradient Accumulation steps: 1
• Warmup ratio: 0.1
• Learning rate: 0.0002
• Optimizer: adamw_torch_fused
• Learning rate scheduler: cosine

Training stats

• Global step: 3152
• Training runtime (seconds): 1163.1262
• Average training loss: 0.0777996052304746
• Final validation loss: 0.051274195313453674

Framework versions

• Unsloth: 2026.3.8
• TRL: 0.22.2
• Transformers: 4.56.2
• Pytorch: 2.10.0+cu128
• Datasets: 4.3.0
• Tokenizers: 0.22.2

License

This model is released under the Llama3 license. See the Terms of Use for details.