spent the entire half of the day building and fixing aha (11am till ~4pm)
posted on twitter
i need to upgrade my demo recording game. time to retire from quicktime player. can someone sponsor me screen studio please.
can't seem to get exa.ai's attention, goal is to be hired as an ml research engineer. at my current state, there's lots to catch up on. i can't even do linear regression proofs. what am i really good at? what are my top 2 skills.
this is their job description
Transformers feel magical -- they understand text at near-human level. Yet traditional search engines (cough, Google) don't feel magical -- they don't understand text at near-human level. It doesn't have to be this way.
At Exa, we're training foundational models for search. Our goal is to build systems that can instantly filter the world's knowledge to exactly what you want, no matter how complex your query. Search is a unique research problem within generative AI -- instead of generating a single piece of text, search involves asking the same questions about billions of texts.
No other AI lab is exploring this direction. That means if we don't find novel methods for search, they won't be found. Our team has already made breakthroughs not seen in the literature, and we have more coming. Want to explore the search frontier with us?
Desired Experience
- You have graduate-level ML experience (or are an exceptionally strong undergrad)
- You can code up a transformer from scratch in pytorch
- You're comfortable creating large-scale datasets
- Care about the problem of finding high quality knowledge and recognize how important this is for the world
Example Projects
- Train a 70B parameter version of our current model
- Build an RLAIF pipeline for search
- Dream up a novel architecture for search in the shower, then code it up and beat our best model's top score
gym'ed for a bit. heartburn is coming back. slightly worried about that.
spent rest of night having dinner at Yee's for A's birthday.
had a good time at our place playing card games about deep questions, liar game, and family style
second time hosting people at our place. we need chairs.
arc on windows has so many bugs. so fun to have an app that i build used by others. i want to build more things. and share it with the world.