Current position
Assistant Professor of MS&E and, by courtesy, of Computer Science and Electrical Engineering
Intersection with the project
Overview
Vasilis Syrgkanis’s research underpins the pillars of adaptability and analytical intelligence of the agricultural chatbot, especially regarding learning user preferences and understanding the cognitive capabilities of artificial intelligence. The researcher’s work focuses on the intersection between machine learning and causal inference, providing the technical foundation for the system not only to process information, but to dynamically “learn” from interaction history and execute complex reasoning necessary for the rural property’s financial management.
”Personalized Adaptation via In-Context Preference Learning” (2024)
This research introduces the Preference Pretrained Transformer (PPT), a framework that allows personalization of language models without the need for constant retraining. The central term is In-Context Learning (ICL), where the model adapts its behavior by appending the history of recent interactions to its prompt. Another relevant term is the Contextual Bandit, a scenario where the AI makes decisions (such as suggesting a response or action) based on context to maximize utility for the user.
Dynamic Adaptation to the Producer’s Routine
- “PPT leverages the in-context learning capabilities of transformers to dynamically adapt to individual preferences.” “PPT leverages the in-context learning capabilities of transformers to dynamically adapt to individual preferences.”
- Intersection: This technology is what underpins the chatbot’s “Continuous Learning Engine”. Since each farm has specific suppliers and routes, the bot uses the WhatsApp conversation history to learn what is a priority for that producer without requiring bureaucratic manual configurations.
Continuous Improvement through Interaction
- “The pretrained model interacts with the user, appends the interaction history to its context and generates more personalized responses.” “The pretrained model interacts with the user, appends the interaction history to its context and generates more personalized responses.”
- Intersection: In the project, the user sends audio messages about urgent demands. The chatbot uses this technique so that, over time, semantic interpretation and alerts become more accurate, reducing forgetfulness-related failures by up to 80% by “getting to know” the manager’s habits better.
”Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning” (2024)
This work investigates how the abilities of a language model (such as Claude, used in the project) are structured hierarchically. The term Causal Representation Learning refers to the identification of hidden factors that explain AI performance. The research demonstrates that complex abilities, such as Mathematical Reasoning, depend on foundational abilities, such as Instruction Following.
Causal Dependency for Financial Management
- “we reveal a clear causal direction starting from general problem-solving capabilities, advancing through instruction-following proficiency, and culminating in mathematical reasoning ability.” “we reveal a clear causal direction starting from general problem-solving capabilities, advancing through instruction-following proficiency, and culminating in mathematical reasoning ability.”
- Intersection: For the chatbot to provide cash flow reports with predictive analysis, it must first excel at following instructions contained in the producer’s audio messages. Syrgkanis’s research validates that the success of the bot’s financial automation depends on the AI’s robustness in interpreting simple field commands.
Precision in Interpreting Operational Commands
- “mathematical tasks demand precise adherence to instructions for correct formatting and problem interpretation, where misunderstandings severely impact accuracy.” “mathematical tasks demand precise adherence to instructions for correct formatting and problem interpretation, where misunderstandings severely impact accuracy.”
- Intersection: The chatbot extracts fiscal data from receipt images and audio messages. Syrgkanis’s finding about the causal link between “following instructions” and “mathematical precision” explains why Advanced Audio Processing is the project’s critical feature: if the AI does not correctly interpret the vocal instruction, calculations for input and fuel waste will be compromised.
Full papers
Vasilis Syrgkanis - Personalized Adaptation via In-Context Preference Learning.pdf Vasilis Syrgkanis - Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning.pdf