Azure OPenAI ChatGPT 4 response is very slow even for a very small context.

GUDURU ARUNKUMAR (LTIMINDTREE LIMITED) 20 Reputation points Microsoft Vendor
2024-05-17T02:50:12.6166667+00:00

Azure OPenAI ChatGPT 4 response is very slow even for a very small context. Whereas for same context, paid version of OpenAI ChatGPT4 is performing faster. We need help in improving the same.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,378 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Charlie Wei 3,225 Reputation points
    2024-05-17T06:33:00.8433333+00:00

    Hello GUDURU ARUNKUMAR (LTIMINDTREE LIMITED),

    Regarding the issue of slow responses with the Azure OpenAI gpt-4 model, the official solution can currently be found in the Performance and Latency article, or, like me, you can look forward to the upcoming release of the gpt-4o model.

    Best regards,
    Charlie


    If you find my response helpful, please consider accepting this answer and voting yes to support the community. Thank you!