Ongoing
Manuscript submitted
2026
Adapting protein language models to thermophile sequence space
- Research question
- How well can a general protein language model represent proteins adapted to extreme environments?
- Challenge
- Protein language models are trained on proteins from organisms living under very different environmental conditions. Apparent improvements can also come from near-duplicate sequences rather than genuine adaptation.
- Approach
- I adapt ProGen2 using LoRA-based supervised fine-tuning, DPO, and KTO under matched compute budgets and homology-controlled evaluation.
- Contribution
- I compare likelihood-based and preference-based adaptation methods under the same compute and evaluation conditions to understand their different strengths and trade-offs.
- Current direction
- I use attribution methods to study which residue, charge, and sequence patterns the adapted models associate with thermophile biology.
- Resources
- Submitted manuscript details