Hi, I’m Ivan.

I am a third-year doctoral researcher at the Center for Doctoral Training in NLP at the University of Edinburgh. I work at the intersection of machine learning and cognitive science, focusing on few-shot learning and generalization in machine learning systems using insights from analogical reasoning. I am supervised by Alex Doumas and Siddharth Narayanaswamy.

Publications

• FoVAE: Reconstructive Foveation as a Self-Supervised Variational Inference Task for Visual Representation Learning
  Ivan Vegner, Siddharth N and Leonidas A. A. Doumas
  NeuRIPS 2023 Workshop on Gaze Meets ML(2023)
  Abstract, PDF
  We present the first steps toward a model of visual representation learning driven by a self-supervised reconstructive foveation mechanism. Tasked with looking at one visual patch at a time while reconstructing the current patch, predicting the next patch, and reconstructing the full image after a set number of timesteps, FoVAE learns to reconstruct images from the MNIST and Omniglot datasets, while inferring high-level priors about the whole image. In line with theories of Bayesian predictive coding in the brain and prior work on human foveation biases, the model combines bottom-up input processing with top-down learned priors to reconstruct its input, choosing foveation targets that balance local feature predictability with global information gain. FoVAE is able to transfer its priors and foveation policy across datasets to reconstruct samples from untrained datasets in a zero-shot transfer-learning setting. By showing that robust and domain-general policies of generative inference and action-based information gathering emerge from simple biologically-plausible inductive biases, this work paves the way for further exploration of the role of foveation in visual representation learning.
• What can MINERVA2 tell us about 'killing hope'? Investigating L2 Collocational Processing with a Memory Model
  Sydelle Souza, Ivan Vegner, Leonidas A. A. Doumas and Francis Mollica
  Proceedings of the Annual Meeting of the Cognitive Science SocietyVolume 45(2023)
  Abstract, PDF
  Collocations are semi-productive word combinations with one word used literally and one other figuratively, characterized by an arbitrary restriction on substitution (kill hope, #murder hope). They are notoriously difficult for L2 speakers to acquire, yet there is no processing model specific to collocations. The present study attempts to explain trends in L2 collocational processing as memory retrieval. Modifying MINERVA2, a frequency-based memory model, we simulate reaction times and compare them to data from 99 L1 and 230 L2 (L1 Portuguese) English speakers involving free combinations (eat cake, ‘comer bolos’), congruent (read minds, ‘ler mentes’) and incongruent collocations (kick habits, no equivalent translation in Portuguese), and nonsense baselines (#read cakes). Under the assumptions that the L2 lexicon develops conditioned on the L1 and that the L2 lexicon is sensitive to L1 frequencies, we report that MINERVA2 can predict processing trends in both L1 and L2 collocational processing.

Contact Me

I’m reachable on my Twitter/X, and you can also email me at <myfirstname> @ <thisdomain> with just about anything!