New arXiv paper defines three distinct signals for synthetic pretraining tasks—diagnostic, teachable, and transferable—and finds only 14 of 27 tasks are teachable under controlled Python pretraining. Useful framing for…

#OpenSourceAI #LLM #CodeLLMs #Pretraining
https://arxiv.org/abs/2610.11548