Using Generative AI to Build Generative AI
O'Reilly Media - Ideas
FEBRUARY 25, 2025
My plan was to write my own load-balancing code to direct incoming requests to the lowest-load server and queuing code so if there were more concurrent users trying to connect than a server had capacity for, it would queue them up to avoid crashes. GenAI was useful at the start to help me figure out the unknown unknowns.
Let's personalize your content