kth8 / LFM2.5-1.2B-Instruct-SuperGPQA-Classifier

A fine-tune of unsloth/LFM2.5-1.2B-Instruct on the m-a-p/SuperGPQA dataset.

Usage example

System prompt

You are a classifier. Categorize the following problem into discipline, field, and subfield in JSON format.

User prompt

Cotton and linen both readily catch fire. A batch of towels is composed of both cotton and linen, and is known to have caught fire. If it is known that the towels were ignited by a lit cigarette, which of the following arguments utilizes the most appropriate form of reasoning?

Assistant response

{"discipline": "Philosophy", "field": "Philosophy", "subfield": "Logic"}

Possible output options

Discipline

['Law', 'Engineering', 'Literature and Arts', 'Sociology', 'Economics', 'Medicine', 'Education', 'History', 'Management', 'Philosophy', 'Science', 'Military Science', 'Agronomy']

Field

['Electronic Science and Technology', 'Library, Information and Archival Management', 'Systems Science', 'Hydraulic Engineering', 'Astronomy', 'Forestry', 'Civil Engineering', 'Environmental Science and Engineering', 'Aquaculture', 'Food Science and Engineering', 'Textile Science and Engineering', 'Clinical Medicine', 'Language and Literature', 'Naval Architecture and Ocean Engineering', 'Geology', 'Political Science', 'Geography', 'Mechanics', 'Chemistry', 'Geophysics', 'Traditional Chinese Medicine', 'Public Health and Preventive Medicine', 'Theoretical Economics', 'Agricultural Engineering', 'Musicology', 'Stomatology', 'Applied Economics', 'Mechanical Engineering', 'Forestry Engineering', 'Journalism and Communication', 'History', 'Weapon Science and Technology', 'Petroleum and Natural Gas Engineering', 'Surveying and Mapping Science and Technology', 'Veterinary Medicine', 'Management Science and Engineering', 'Public Administration', 'Oceanography', 'Pharmacy', 'Power Engineering and Engineering Thermophysics', 'Metallurgical Engineering', 'Business Administration', 'Information and Communication Engineering', 'Transportation Engineering', 'Law', 'Architecture', 'Animal Husbandry', 'Physics', 'Physical Education', 'Basic Medicine', 'Education', 'Mining Engineering', 'Electrical Engineering', 'Computer Science and Technology', 'Military Science', 'Biology', 'Crop Science', 'Materials Science and Engineering', 'Aeronautical and Astronautical Science and Technology', 'Instrument Science and Technology', 'Optical Engineering', 'Control Science and Engineering', 'Physical Oceanography', 'Geological Resources and Geological Engineering', 'Sociology', 'Philosophy', 'Atmospheric Science', 'Art Studies', 'Nuclear Science and Technology', 'Mathematics', 'Chemical Engineering and Technology', 'Psychology']

Subfield

['Solar System Science', 'Signal and Information Processing', 'Systems Science', 'Anesthesiology', 'Agricultural Environment and Soil-Water Engineering', 'Neurology', 'Broadcasting and Television Art', 'Human Anatomy and Histology-Embryology', 'Social Medicine and Health Management', 'Subatomic and Atomic Physics', 'Combinatorial Mathematics', 'Pharmaceutical Analysis', 'Criminal Law', 'Microbiology and Biochemical Pharmacy', 'Communication Principles', 'Acoustics', 'Textile Materials Science', 'Power Electronics and Electrical Drives', 'Marine Engineering', 'Water conservancy and Hydropower Engineering', 'Fluid Machinery and Engineering', 'Forest Cultivation and Genetic Breeding', 'Landscape Plants and Ornamental Horticulture', 'Space physics', 'National and Defense Economics', 'Classical Chinese Literature', 'Traffic Information Engineering and Control', 'Clinical Laboratory Diagnostics', 'Russian Language and Literature', 'Industrial Economics', 'Fundamentals of Dynamics and Control', 'Principles of Computer Organization', 'Special Education', 'Library and Archival Science', 'Astronomical Observation and Technology', 'Traditional Chinese Medicine Theory', 'Refrigeration and Cryogenic Engineering', 'Military Thought and History', 'Hydrogeology', 'Digital Surveying and Remote Sensing Applications', 'Applied Optics', 'Advanced Algebra', 'Literary Theory', 'Theoretical Optics', 'Traditional Chinese Health Preservation', 'Crop Science', 'Oil and Gas Field Development and Storage & Transportation Engineering', 'Historical Geography', 'Political Economy', 'Stellar and Interstellar Evolution', 'Philosophical Aesthetics', 'Solid State Physics', 'Economic History', 'Control Theory and Control Engineering', 'Geriatric Medicine', 'Mechatronic Engineering', 'Architectural Design and Theory', 'Fluid Flow and Heat Transfer in Chemical Engineering', 'Animal Nutrition and Feed Science', 'Thermal Energy Engineering', 'Computer Software and Theory', 'Animal Rearing and Breeding', 'Genetics', 'Oncology', 'Aquaculture', 'Environmental Science', 'Physical Education and Training', 'Communication and Broadcasting', 'High Voltage and Insulation Technology', 'Atomic and Molecular Physics', 'Internal Medicine', 'Power Machinery and Engineering', 'Mathematical Analysis', 'Law and Social Governance', 'Materials Processing Engineering', 'Political Science', 'Computational Mathematics', 'Health Toxicology and Environmental Health', 'Structural Geology', 'Theoretical Mechanics', 'Tourism Management and Technological Economics Management', 'Geometry and Topology', 'Engineering Fluid Mechanics', 'Fluid Physics', 'Instrumentation and Performance', 'Dynamic Meteorology', 'Imaging and Nuclear Medicine', 'Organic Chemistry', 'Formal Languages', 'Relativity', 'Military Management', 'Textile Chemistry and Dyeing Engineering', 'Meteorology', 'Computer Networks', 'Harmony', 'Radiation Medicine', 'Management Science and Engineering', 'Clinical Stomatology', 'Sports Science and Medicine', 'Pitch and Scales', 'Thermodynamics and Statistical Physics', 'Environmental Engineering', 'Functions of Complex Variables', 'Otorhinolaryngology', 'Educational Technology and Principles', 'Physical Chemistry', 'Epidemiology and Health Statistics', 'Analytical Chemistry', 'Design Arts', 'Communication and Information Systems', 'Operating Systems', 'World History', 'Instrument Science and Technology', 'Mineral Processing Engineering', 'Special Number Theory', 'Sports Humanities and Sociology', 'Food Processing and Storage Engineering', 'Marine Biology', 'Environmental and Resource Protection', 'Contract Law', 'Preschool Education', 'Linguistics and Applied Linguistics', 'Philosophy of Science and Technology', 'Principles of Seismic Exploration', 'Group Theory', 'Social and Folklore Studies', 'Forest Engineering', 'Marine Chemistry', 'Inorganic Chemistry', 'Advanced Programming Languages', 'Electrical Theory and New Technologies', 'Demography and Anthropology', 'Constitutional and Administrative Law', 'Theory of Curriculum and Instruction', 'Data Structures', 'Immunology', 'International Law', 'Physical Geography', 'Thermodynamics', 'Non-ferrous Metallurgy', 'Geodesy and Surveying Engineering', 'Labor Economics', 'Statistical Mechanics', 'Databases', 'Engineering Thermophysics', 'Emergency Medicine', 'Biophysics', 'Education Economics, Management and Social Security', 'Polynomials and Series Expansions', 'Materials Physics and Chemistry', 'Pathology and Pathophysiology', 'Astrophysics', 'Computer Architecture', 'Semiconductor Physics', 'Medicinal Chemistry', 'Theoretical Fluid Mechanics', 'Fine Arts', 'Music History, Education, and Technology', 'Legal Theory and Legal History', 'Mineralogy, Petrology, and Economic Geology', 'Paleontology and Stratigraphy', 'Military Logistics and Equipment', 'Graph Theory', 'Procedural Law', 'Obstetrics and Gynecology', 'Business and Accounting Management', 'Functions of Real Variables', 'Philology and Bibliography', 'Manufacturing Automation', 'Mass Transport and Separation Process in Chemical Engineering', 'Quantum Mechanics', 'Radiation Protection and Nuclear Technology Applications', 'Religious Studies', 'Electrodynamics', 'Composition', 'Solid Earth Geophysics', 'Bridge and Tunnel Engineering', 'Fuzzy Mathematics', 'Pathogen Biology', 'Western Economics', 'French Language and Literature', 'Film Studies', 'Optoelectronic Technology', 'Rigid Body Mechanics', 'Physical Chemistry of Metallurgical Process', 'Polymer Physics', 'Urban Planning and Design', 'Aeronautical and Astronautical Science and Technology', 'Ship Mechanics and Design Principles', 'Ethics', 'Vehicle Operation Engineering', 'Physical Oceanography', 'Radiochemistry', 'Agricultural Mechanization Engineering', 'Quantitative Economics', 'Logic', 'Chemical Transport Engineering', 'Nursing and Rehabilitation Medicine', 'Stochastic Processes', 'Zoology', 'Botany', 'Discrete Mathematics', 'Journalism and News Practice', 'Cosmology', 'Power Systems and Automation', 'Psychiatry and Mental Health', 'Basic Stomatology', 'Nutrition and Food Hygiene', 'Pattern Recognition', 'Guidance, Navigation and Control', 'Underwater Acoustics', 'Forensic Medicine', 'Mining and Safety Engineering', 'Ecology', 'International Trade', 'Polymer Chemistry and Physics', 'Public Finance', 'Cryptography', 'Literary History', 'Microelectronics and Solid-State Electronics', 'Archaeology and Museology', 'Dermatology and Venereology', 'Geochemistry', 'Structural Engineering', 'Electromagnetic Field and Microwave Technology', 'Iron and Steel Metallurgy', 'Pharmaceutics', 'Particle and Nuclear Physics', 'Internal Combustion Engineering', 'Surgery', 'Atmospheric Physics and Atmospheric Environment', 'Military Command and Information Systems', 'Fundamental Mathematics', 'Cartography and Geographic Information Engineering', 'Operations Research and Cybernetics', 'Information Management and Communication', 'Veterinary Medicine', 'Ordinary Differential Equations', 'Traditional Chinese Pharmacy', 'Numerical Analysis', 'Modern and Contemporary Chinese Literature', 'Transportation Planning and Management', 'Pharmacology', 'Laser Technology', 'Nuclear Energy and Reactor Technology', 'Solid Mechanics', 'Military Law', 'History and Theory of Journalism and Media Management', 'Hydraulics and Hydrology', 'Dance Studies', 'Food Biochemistry', 'Architectural History', 'Information Management Science', 'Physiology', 'Wood Science and Technology', 'Geotechnical Engineering', 'Road and Railway Engineering', 'Principles of Metallurgy', 'Heat Transfer', 'Poromechanics and Reservoir Physics', 'Civil and Commercial Law', 'Musical Forms and Analysis', 'Land Resource Management and Administrative Management', 'Biochemistry and Molecular Biology', 'Cell Biology', 'Urban Infrastructure Engineering', 'Antenna and Radio Communication', 'Drama and Opera Studies', 'Military Chemistry and Pyrotechnics', 'Probability and Statistics', 'Geological Resources and Geological Engineering', 'Elements of Chemical Reaction Engineering', 'Circuits and Systems', 'Weapon Systems Science and Engineering', 'Maternal, Child and Adolescent Health', 'Optical Fiber Communication', 'Ophthalmology', 'Electrochemistry', 'Number Theory', 'Human Geography', 'Finance', 'Microbiology', 'Pediatrics', 'Economic Statistics', 'Psychology']

Model Details

• Base Model: unsloth/LFM2.5-1.2B-Instruct
• Parameter Count: 1170340608
• Precision: torch.bfloat16

Training Settings

Hardware

• GPU: NVIDIA A100-SXM4-40GB

PEFT

• Rank: 32
• LoRA alpha: 64
• Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj

SFT

• Epoch: 2
• Batch size: 16
• Gradient Accumulation steps: 1
• Warmup ratio: 0.1
• Learning rate: 0.0002
• Optimizer: adamw_torch_fused
• Learning rate scheduler: cosine

Training stats

• Global step: 3152
• Training runtime (seconds): 869.5745
• Average training loss: 0.11308082351035575
• Final validation loss: 0.05242228880524635

Framework versions

• Unsloth: 2026.3.8
• TRL: 0.22.2
• Transformers: 4.56.2
• Pytorch: 2.10.0+cu128
• Datasets: 4.3.0
• Tokenizers: 0.22.2

License

This model is released under LFM Open License v1.0. See the Terms of Use for details.