About

Magic Search started as an exploration of the idea of "live markets", specifically live job markets; where rather than having to market yourself as something simple and legible (such as "software engineer"), you could instead become visible as your full self, with all your talents and interests on display, without having to even think about the comms of it all. Ideally this would lead to more meaningful, valuable, and idiosyncratic collaborations and opportunities.

I'm interested in safeguarding job security for humans in the future, because I worry about large-scale unrest as a result of displacement of humans by AI, and I'm concerned what will happen when humans are no longer incentivised to strive for personal progress (self-actualisation), and governments no longer incentivised to invest in their population.

I go into some background in this tweet thread. The idea of "live markets" emerged from the Live Theory research group.

Magic Search was built as part of the AI for Human Reasoning fellowship by the Future of Life Foundation.

Data

All our data is sourced from the Community Archive, a database of 270+ tweet archives submitted by X users. Anyone can upload their own X archive.

If you want your account to show up in the Magic Search results, you can upload your archive and support the project!

Data processing

For every indexed user, we fetch all their authored tweets and generate a summary of the person based on the archive. Currently we're using GPT-4.1-mini. Username, display name, and bio, as well as retweets and liked tweets, are excluded from the generation of the summary.

If you think your account isn't represented properly, it's probably a prompting error, or GPT-4.1-mini isn't intelligent enough to capture your magic with sufficient subtleness. Reach out to me if so.

To see the prompts we use to generate the user summaries, see the project source code.

I want my user in/out/changed!

Reach out to me via Twitter or email (hello at sofiavanhanen dot fi). Indexing new users currently happens manually, so even if you add your archive to Community Archive today, it won't show up here until I run the script for it. If you're unhappy with the representation of your user, I'd like to hear about it; I can remove you from the index, or we can work on the prompts so that your magic is captured more accurately.