Microsoft Reveals a Drawing Bot
Events
Subscribe:  iCal  |  Google Calendar
7, Mar — 12, Jun
London GB   29, May — 1, Jun
Birmingham GB   1, Jun — 4, Jun
Taipei TW   5, Jun — 10, Jun
Los Angeles US   12, Jun — 15, Jun
Latest comments

I have being working in the AAA industry for tha last 3 years and the crunch is what is forcing me to find something else to do in life even if I love 3d. Some places may be more respectful with their employees but in my experience the crunch is even calculated in advance cause they know the workers will accept that. Some people is very passionate and don´t mind to do it and that is fine but a lot of people have families and they want to build a healthy environment with them or other goals outside the working ours. Not to mention non-payed overtime and other abuses I faced. Hope this industry fixs this problem.

by uuuuuuuuuuuuuuuu
14 hours ago

uu

by BakingSoda
1 days ago

Those tilesets are sexy. Seeing new tilesets is like getting introduced to a new lego set.

Microsoft Reveals a Drawing Bot
22 January, 2018
News

Microsoft revealed a new AI technology that’s described as an artist — a “drawing bot.” The bot can generate images from text descriptions of an object, but it is also capable of adding details that weren’t mentioned in the text, meaning that the AI holds a little imagination of its own, states Microsoft.

The new artificial intelligence technology under development in Microsoft’s research labs is programmed to pay close attention to individual words when generating images from caption-like text descriptions. This deliberate focus produced a nearly three-fold boost in image quality compared to the previous state-of-the-art technique for text-to-image generation, according to results on an industry standard test reported in a research paper posted on arXiv.org.

The technology, which the researchers simply call the drawing bot, can generate images of everything from ordinary pastoral scenes, such as grazing livestock, to the absurd, such as a floating double-decker bus. Each image contains details that are absent from the text descriptions, indicating that this artificial intelligence contains an artificial imagination.

Microsoft 

The research group started with technology that automatically writes photo captions – the CaptionBot – and then switched to a technology that “answers questions humans ask about images“, like the location or attributes of objects.

This system is said to use “training machine learning models to identify objects, interpret actions and converse in natural language”

If you go to Bing and you search for a bird, you get a bird picture. But here, the pictures are created by the computer, pixel by pixel, from scratch. These birds may not exist in the real world — they are just an aspect of our computer’s imagination of birds.

Xiaodong He, a principal researcher and research manager 

The core of Microsoft’s new AI is a technology called a Generative Adversarial Network, or GAN. The network features two machine learning models. The first one builds images from text descriptions and the other one, known as a discriminator, uses text descriptions to judge the authenticity of generated images. 

Drawing bot was trained on datasets that contain paired images and captions, which allow the models to learn how to match words to the visual representation of those words. The GAN, for example, learns to generate an image of a bird when a caption says bird and, likewise, learns what a picture of a bird should look like. “That is a fundamental reason why we believe a machine can learn,” said He.

GANs work well when generating images from simple text descriptions such as a blue bird or an evergreen tree, but the quality stagnates with more complex text descriptions such as a bird with a green crown, yellow wings and a red belly. That’s because the entire sentence serves as a single input to the generator. The detailed information of the description is lost. As a result, the generated image is a blurry greenish-yellowish-reddish bird instead a close, sharp match with the description.

Microsoft 

You can find more details on the bot in the official announcement

Leave a Reply

Be the First to Comment!

avatar
wpDiscuz