Models take too long to generate a response

#566
by Aspect004 - opened

I've noticed that the models often take an unusually long time to respond, sometimes minutes, which is extremely cumbersome. Please consider improving the speed performance of the models. Maybe server infrastructure optimization would improve.

Aspect004 changed discussion title from Models Take too Long to Generate a Response to Models take too long to generate a response

What's happening?

Sign up or log in to comment