GenAI usage with custom OpenAI api path

  • Creator
    Topic
  • #259587
    Joey BaljöhrJoey Baljöhr
    Participant
      @joens1337

      Dear all,

      I was able to set up my local AI model and interact with it, based on a state machine. However my developer computer doesn’t provide sufficient power to run the AI as I need.

      Therefore we have an local AI computer where I run a LM Studio Server which is open to our local network and can operate with OpenAI API calls. The thing where im struggeling is, the GenAI.OpenAI.Open.vi where the api_path seems to be hard coded and can’t be changed.

      Is there any chance to get the mentioned Open.vi with an additional input parameter for the api_path which will be used and integrated into the cluster?

       

      Thank you and kind regards!

      Joey

    • Author
      Replies
    • #259590
      Youssef MENJOURYoussef MENJOUR
      Admin
        @youssefmenjour

        Hi Joey,

        Thank you for your suggestion – that’s a great use case and we fully understand the need to customize the api_path, especially when working with local servers like LM Studio.

        Perrine from our team will follow up on this post and take over the discussion. She’ll assist you with the necessary updates and guide you through the process.

        Thanks again for your feedback!

        Best regards,
        Youssef – Graiphic Team

        #259595
        Perrine CipolloniPerrine Cipolloni
        Participant
          @perrine2818

          Hello Joey,

          I’m Perrine from the GRAIPHIC team. Thank you for your feedback.
          We’ve released a new version that now allows you to add a custom API path in the Open.vi method, making it better suited to your specific use case.

          Feel free to reach out if you need any assistance or further adjustments.

          Best regards,
          Perrine – GRAIPHIC Team

          #259596
          Joey BaljöhrJoey Baljöhr
          Participant
          Participant
            @joens1337

            Dear Youssef, dear Perrine,

            Thank you for your fast response and especially for that fast feature implementation. I already updated to the recent release of the GenAI package and it looks well. My custom api_path was accepted by the Open.vi and managed to get into the cluster as intended!

            Best regards,

            Joey

          • You must be logged in to reply to this topic.