Tales From the Cloud Data & Analytics Crypt #9: "The Mind's Machination"

Greetings, boils and ghouls! It's time to delve into the diabolical depths of the Crypt once again. Tonight's chilling tale is a wicked web woven with wires and whispers of the technological kind. So, strap yourselves in tightly, as we venture into the eerie realm of OpenAI and ChatGPT in this electrifying episode of Tales from the Crypt: "The Mind's Machination."

Ah, my friends, it seems technology has taken a wicked turn. Deep within the bowels of the Crypt, a horrifying creation has been unearthed - an ChatGPT that will leave you screaming for mercy! But as with any creation, dear viewers, there are both whispers of opportunity and shadows of risk.

Let's dive into some do's and don'ts of OpenAI world - unfortunately base on customers learnings.

First thing first:

• OpenAI is an American artificial intelligence (AI) research laboratory consisting of the non-profit OpenAI Incorporated and its for-profit subsidiary corporation OpenAI Limited Partnership. OpenAI conducts AI research with the declared intention of promoting and developing a friendly AI. OpenAI systems run on an Azure-based supercomputing platform from Microsoft

Based on this fact you can assume than OpenAI = Azure OpenAI Service. But in reality IT'S NOT THE SAME.

Here are some fact to consider before using OpenAI and/or Azure OpenAI Service.

In fact Microsoft has formed a partnership with OpenAI to collaborate on the development of artificial intelligence technologies. The partnership aims to accelerate the development of advanced AI systems and bring the benefits of AI to more people.

As part of the partnership, Microsoft and OpenAI have agreed to work together on several key areas, including:

? Developing AI technologies: The two companies are collaborating on the development of new AI models and algorithms, with a focus on natural language processing, computer vision, and other areas of AI.

? Building an AI computing platform: Microsoft and OpenAI are working together to build a new AI computing platform that will allow developers to easily access and use advanced AI models and algorithms.

? Advancing AI research: The two companies are also collaborating on a range of research projects aimed at advancing the state of the art in AI.

? Making AI more accessible: The partnership aims to make AI more accessible to a wider range of developers and organizations, in order to bring the benefits of AI to more people.

Microsoft has also announced it will use OpenAI's GPT-3 technology to add more capabilities to its products.

Additionally Microsoft has also made an investment in OpenAI, allowing the company to use Microsoft Azure as its preferred cloud platform, and allowing OpenAI to tap into the vast resources of Microsoft to accelerate its research. This partnership gives OpenAI the ability to scale its models and services on Azure and make them more widely available to customers.

What does it mean in reality:

• When you are going to OpenAI page, login/create account there you are using service provided by OpenAI company. You can chose to use ChatGPT, DALL-E, API functionality (as shown on image below).

• On the other hand you can consider using Azure OpenAI Service which provides REST API access to OpenAI's powerful language models including the GPT-3, Codex and Embeddings model series. These models can be easily adapted to your specific task including but not limited to content generation, summarization, semantic search, and natural language to code translation. Users can access the service through REST APIs, Python SDK, or our web-based interface in the Azure OpenAI Studio. Not all models are available in all regions currently. Refer to the model capability table for a full breakdown.

OK I still don't get it. Let's go one step deeper then..

Imagine you are using OpenAI and GPT model provided through ChatGPT functionality. In this case you should follow the ChatGPT — Release Notes | OpenAI Help Center to understand which model in fact you are using. As an example, on March 14th Open AI announced ability to use GPT-4 and at the same time ability to choose between different versions of ChatGPT for Plus subscribers. Meanwhile free users of ChatGPT are using default model which is upgraded based on planned rollout process.

In opposite when you want to use Azure OpenAI Service you have to:

• setup Azure OpenAI service on one of your Azure subscriptions, however you can see such notification:

This is because Azure OpenAI access is currently limited. There are few factor behind this like high demand, upcoming product improvements, and Microsoft’s commitment to responsible AI. For now, Microsoft is working with customers with an existing partnership with Microsoft, lower risk use cases, and those committed to incorporating mitigations.

More specific information is included in the application form. If you would like to use Azure Open AI apply now for access. Once approved you will be able to use Azure OpenAI Service models of you choice.

Wait that's all?

In fact this is only one difference, even more important one is how your data is handled. Let's see what OpenAI wrote about customer data usage:

ChatGPT

When you use our non-API consumer services ChatGPT or DALL-E, we may use the data you provide us to improve our models. You can switch off training in ChatGPT settings (under Data Controls) to turn off training for any conversations created while training is disabled or you can submit this form. Once you opt out, new conversations will not be used to train our models.

API

OpenAI does not use data submitted by customers via our API to train OpenAI models or improve OpenAI’s service offering. In order to support the continuous improvement of our models, you can fill out this form to opt-in to share your data with us.

At the same time Microsoft never ever uses  customer data to train, retrain or improve the models in the Azure OpenAI Service. There is even more, if there are any rare circumstances where such access is required (e.g. support) , Customer Lockbox for Microsoft Azure provides an interface for customers to review and approve or reject customer data access requests. Customer Lockbox is used in cases where a Microsoft engineer needs to access customer data, whether in response to a customer-initiated support ticket or a problem identified by Microsoft. In the Azure OpenAI Service, Customer Lockbox applies to all customer data stored by the service (such as data uploaded for fine-tuning). Also be aware that with Azure OpenAI Customer-managed keys (CMK), also known as Bring your own key (BYOK) cam be used. This gives greater flexibility to create, rotate, disable, and revoke access controls. You can also audit the encryption keys used to protect your data. CMK encrypts all customer data stored at rest in the Azure OpenAI Service. Check more on Data, privacy, and security for Azure OpenAI Service page.

Last but not least. With huge Microsoft’s commitment to responsible AI The Azure OpenAI Service includes a content management system that works alongside the models to filter potentially harmful content. This system works by running both the input prompt and generated completion through an ensemble of classification models aimed at detecting misuse. If the system identifies harmful content, customers receive either an error on the API call if the prompt was deemed inappropriate or the finish_reason on the response will be content_filter to signify that some of the generation was filtered. Learn more about content filtering here. No prompts or completions are stored in these content classification models; prompts and completions are not used to train, retrain or improve the classification models.

Remember, my petrified pals, OpenAI's model wields both opportunity and peril. As we wander through this labyrinth of human-like machines, tread lightly, for the boundaries between fact and fiction become blurred.

As we bid you farewell, my chilling compatriots, heed this warning: in the realm of OpenAI and the ChatGPT model, the line between friend and fiend can

be dreadfully thin. Embrace the boundless potential, but never forget the price of surrendering your mortal essence to the cold embrace of the algorithmic abyss.

Until we meet again, my brave souls, sleep with one eye open. After all, you never know what horrors lurk beneath the guise of artificial intelligence.