ChatGPT’s Advanced Voice Mode finally gets visual context on the 6th day of OpenAI

With the vacation season upon us, many firms are discovering methods to take benefit via offers, promotions, or different campaigns. OpenAI has discovered a option to take part with its “12 days of OpenAI” occasion sequence.

On Wednesday, OpenAI introduced by way of an X submit that beginning on Dec. 5, the corporate would host 12 days of reside streams and launch “a bunch of recent issues, massive and small,” in accordance with the submit. 

Here is the whole lot it is advisable to know concerning the marketing campaign, in addition to a round-up of day by day’s drops. 

What are the ’12 days of OpenAI’?

OpenAI CEO Sam Altman shared a bit extra particulars concerning the occasion, which kicked off at 10 a.m. PT on Dec. 5 and can happen each day for 12 weekdays with a reside stream that includes a launch or demo. The launches shall be each “massive ones” or “stocking stuffers,” in accordance with Altman. 

What has been dropped to date?

Thursday, December 12

When the reside stream began, OpenAI addressed the elephant within the room — the truth that the corporate’s reside stream went down the day earlier than. OpenAI apologized for the inconvenience and mentioned its crew is engaged on a autopsy to be posted later right this moment. 

Then it received straight into the information — one other highly-anticipated announcement: 

• Superior Voice Mode now has screen-sharing and visible capabilities, that means it could possibly help with the context of what it’s viewing, whether or not that be out of your cellphone digicam or what’s in your display screen. 
• These capabilities construct on what Superior Voice might already do very properly — partaking in informal dialog as a human would. The natural-like conversations may be interrupted, have multi-turns, and perceive non-linear trains of thought. 
• Within the demo, the person will get instructions from ChatGPT’s Superior Voice on how you can make a cup of espresso. Because the demoer goes via the steps, ChatGPT is verbally providing insights and instructions. 
• There’s one other bonus for the Christmas season: Customers can entry a brand new Santa voice. To activate it, all customers must do is click on on the snowflake icon. Santa is rolling out all through right this moment in all places that customers can entry ChatGPT voice mode. The primary time you speak to Santa, your utilization limits reset, even when you’ve got reached the restrict already, so you possibly can have a dialog with him. 
• Video and display screen sharing are rolling out within the newest cell apps beginning right this moment and all through subsequent week to all Staff customers and most Professional and Plus subscribers. Professional and Plus subscribers in Europe will get entry “as quickly as we will,” and Enterprise and Edu customers will get entry early subsequent 12 months. 

Wednesday, December 11

Apple launched iOS 18.2 right this moment. The discharge consists of integrations with ChatGPT throughout Siri, Writing Instruments, and Visible Intelligence. Consequently, right this moment’s reside stream centered on strolling via the mixing. 

• Siri can now acknowledge whenever you ask questions outdoors its scope that might profit from being answered by ChatGPT as a substitute. In these cases, it’ll ask if you would like to course of the question utilizing ChatGPT. Earlier than any request is distributed to ChatGPT, a message notifying the person and asking for permission will at all times seem, inserting management within the person’s fingers as a lot as potential. 
• Visible Intelligence refers to a brand new characteristic for the iPhone 16 lineup that customers can entry by tapping the Digicam Management button. As soon as the digicam is open, customers can level it at one thing and search the online with Google, or use ChatGPT to be taught extra about what they’re viewing or carry out different duties comparable to translating or summarizing textual content. 
• Writing Instruments now includes a new “Compose” instrument, which permits customers to create textual content from scratch by leveraging ChatGPT. With the characteristic, customers may even generate photographs utilizing DALL-E. 

All the above options are topic to ChatGPT’s each day utilization limits, the identical manner that customers would attain limits whereas utilizing the free model of the mannequin on ChatGPT. Customers can select whether or not or to not allow the ChatGPT integration in Settings.

Learn extra about it right here: iOS 18.2 rolls out to iPhones: Strive these 6 new AI options right this moment

Tuesday, December 10 

• Canvas is coming to all internet customers, no matter plan, in GPT-4o, that means it’s now not simply accessible in beta for ChatGPT Plus customers.
• Canvas has been constructed into GPT-4o natively, that means you possibly can simply name on Canvas as a substitute of getting to go to the toggle on the mannequin selector. 
• The Canvas interface is similar as what customers noticed in beta in ChatGPT Plus, with a desk on the left hand facet that reveals the Q+A trade and a right-hand tab that reveals your venture, displaying all the edits as they go, in addition to shortcuts. 
• Canvas will also be used with customized GPTs. It’s turned on by default when creating a brand new one, and there may be an possibility so as to add Canvas to current GPTs. 
• Canvas additionally has the flexibility to run Python code straight in Canvas, permitting ChatGPT to execute coding duties comparable to fixing bugs. 

Learn extra about it right here: I am a ChatGPT energy person – and Canvas continues to be my favourite productiveness characteristic a month later

Monday, December 9

OpenAI teased the third-day announcement as “one thing you have been ready for,” adopted by the much-anticipated drop of its video mannequin — Sora.  Here is what it is advisable to know:

• Referred to as Sora Turbo, the video mannequin is smarter than the February mannequin that was previewed. 
• Entry is coming within the US later right this moment; customers want solely ChatGPT Plus and Professional.
• Sora can generate video-to-video, text-to-video, and extra. 
• ChatGPT Plus customers can generate as much as 50 movies monthly at 480p decision or fewer movies at 720p. The Professional Plan gives 10x extra utilization. 
• The brand new mannequin is smarter and cheaper than the previewed February mannequin. 

• Sora options an discover web page the place customers can view one another’s creations. Customers can click on on any video to see the way it was created. 
• A reside demo confirmed the mannequin in use. The demo-ers entered a immediate and picked side ratio, period, and even presets. I discovered the reside demo video outcomes to be real looking and beautiful. 
• OpenAI additionally unveiled Storyboard, a instrument that lets customers generate inputs for each body in a sequence. 

Friday, December 6:

On the second day of “shipmas,” OpenAI expanded entry to its Reinforcement Wonderful-Tuning Analysis Program:

• The Reinforcement Wonderful-Tuning program permits builders and machine studying engineers to fine-tune OpenAI fashions to “excel at particular units of complicated, domain-specific duties,” in accordance with OpenAI. 
• Reinforcement Wonderful-Tuning refers to a customization method by which builders can outline a mannequin’s habits by inputting duties and grading the output. The mannequin then makes use of this suggestions as a information to enhance, turning into higher at reasoning via related issues, and enhancing general accuracy.
• OpenAI encourages analysis institutes, universities, and enterprises to use to this system, notably people who carry out slender units of complicated duties, may benefit from the help of AI, and carry out duties which have an objectively right reply. 
• Spots are restricted; candidates can apply by filling out this kind. 
• OpenAI goals to make Reinforcement Wonderful-Tuning publicly accessible in early 2025.

Thursday, December 5: 

OpenAI began with a bang, unveiling two main upgrades to its chatbot: a brand new tier of ChatGPT subscription, ChatGPT Professional, and the complete model of the corporate’s o1 mannequin. 

The total model of o1: 

• Shall be higher for all types of prompts, past math and science
• Will make main errors about 34% much less typically than o1-preview, whereas eager about 50% quicker
• Rolls out right this moment, changing o1-preview to all ChatGPT Plus and now Professional customers 
• Lets customers enter photographs, as seen within the demo, to offer multi-modal reasoning (reasoning on each textual content and pictures) 

ChatGPT Professional:

• Is supposed for ChatGPT Plus superusers, granting them limitless entry to one of the best OpenAI has to supply, together with limitless entry to OpenAI o1-mini, GPT-4o, and Superior Mode
• Options o1 professional mode, which makes use of extra computing to purpose via the toughest science and math issues 
• Prices $200 monthly 

The place are you able to entry the reside stream?

The reside streams are held on the OpenAI web site, and posted to its YouTube channel instantly after. To make entry simpler, OpenAI may also submit a hyperlink to the reside stream on its X account 10 minutes earlier than it begins, which shall be at roughly 10 a.m. PT/1 p.m. ET each day. 

What are you able to anticipate?

The releases stay a shock, however many anticipate that Sora, OpenAI’s video mannequin initially introduced final February, shall be launched as a part of one of many greater drops. Since that first announcement, the mannequin has been accessible to a choose group of pink teamers and testers and was leaked final week by some testers over grievances about “unpaid labor,” in accordance with experiences.  

Different rumored releases embrace a brand new, fuller model of the corporate’s o1 LLM with extra superior reasoning capabilities, and a Santa voice for OpenAI’s Superior Voice Mode, per code noticed by customers solely a few weeks in the past underneath the codename “Straw.”