GENAI – Anupam Ranku

The Sydney Global Azure event was held on Saturday, May 10th, at Microsoft Reactor. As usual, it was a vibrant event with many thoughtful discussions.

The topic of my presentation was “Effective API Governance in the Era of AI with Azure Integration Services“

Synopsis: API integrations continue to offer higher business performance and enable innovative automation. Building an integrated governance model to manage APIs effectively became crucial, especially when handling the complexity of AI-driven workloads.
In the session, I showcased how to use Azure’s powerful suite of integration services, including Azure GenAI Gateway, Azure API Center, Azure API Management, and Azure Policy, to boost reliability, security, and compliance while accelerating API development and innovation rather than creating organisational obstacles and bottlenecks.

In the session, we had a deeper dive into the following two very important Azure services:

I have made the slide available here

It was great to see some familiar faces

Below, I have listed some of the useful reference links on this topic:

Several resources were shared during Microsoft AI Partner Training Day & Microsoft AI Tour Sydney conference that I found quite handy. I have collated those below for myself and for others to benefit from.

Some of the AI Tour speakers have uploaded their slides and resources in the following repo:
https://github.com/microsoft/aitour-repo-principal-list

Learning
Microsoft announced that they would skill 1 million Aussies and Kiwis – which shows the growth we anticipate in the coming years. The following link can be a great start to keep up with AI learning.
https://aiskillsnavigator.microsoft.com/en-us

GenAI Beginners -21 Lessons
Generative AI For Beginners – This course contains 21 lessons and was designed by Microsoft Cloud Advocates.
https://github.com/microsoft/generative-ai-for-beginners/tree/main

Azure AI Foundry
Azure AI Studio is now the Azure AI Foundry portal. Azure AI Foundry is the new platform that allows developers to explore various models, services, and capabilities and quickly build AI applications. The organisation can also use their Azure subscription (MACC quota) to build and run AI models, which will remove the upfront investment cost of such a project.
https://ai.azure.com/

Open-Source Samples
Open-source repos with chat AI (backend) and web UI (frontend) samples used during the AI Tour presentation and workshop
– https://github.com/Azure-Samples/contoso-chat
– https://github.com/Azure-Samples/contoso-web

Prompty
Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers. The primary goal is accelerating the developer inner loop of prompt engineering and prompt source management in a cross-language and cross-platform implementation.
– https://prompty.ai/
– https://www.prompty.ai/docs
– https://github.com/Microsoft/prompty/
– https://microsoft.github.io/promptflow/how-to-guides/index.html

Copilot for Security Prompt Library: Samples, Templates, and Promptbooks
The link contains prompt examples, prompting templates, and promptbooks for use with Copilot for Security to provide ideas to build and create our own prompt.
– https://github.com/rod-trent/Copilot-for-Security/tree/main/Prompts

Kubernetes AI Toolchain Operator (Kaito)
Kaito is an operator that automates AI/ML model inference and tuning workloads in Kubernetes, supporting large open-source models like Falcon and Phi-3, with features like containerised model management, GPU auto-provisioning, and support for popular inference runtimes.
– https://github.com/kaito-project/kaito/tree/main

Top technical patterns with GenAI that support business use cases