Recently, Generative AI, and at the top of it, LLMs have been introduced as a revolutionary technology. Although LLMs, like ChatGPT, have demonstrated astonishing performance in various tasks, they require different components for specialized uses to be able to show appropriate performance. We have provided an infrastructure in Tapsage that offers solutions by designing different tools and components that can be used for performing various tasks and different models. In this presentation, we intend to discuss the challenges of building intelligent systems based on Generative AI, and what solutions we have provided at Tapsage to address these challenges.