Researchers are exploring tabular foundation models and JEPA-style approaches, experimenting with loss functions and representations such as contrastive learning.

“So even just like tabular foundation models are now sort of being tried out. There's a lot of JEPA type of approaches now because there's like we have one thing where we use contrastive learning. So it's just people playing around with the losses but also with the representations.”