Need smarter insights in your inbox? Join our weekly newsletters to get solely what issues to enterprise AI, knowledge, and safety leaders. Subscribe Now
After seizing the summer time with a blitz of highly effective, freely obtainable new open supply language and coding targeted AI fashions that matched or in some circumstances bested closed-source/proprietary U.S. rivals, Alibaba’s crack “Qwen Group” of AI researchers is again once more as we speak with the discharge of a extremely ranked new AI picture generator mannequin — additionally open supply.
Qwen-Picture stands out in a crowded subject of generative picture fashions as a consequence of its emphasis on rendering textual content precisely inside visuals — an space the place many rivals nonetheless battle.
Supporting each alphabetic and logographic scripts, the mannequin is especially adept at managing complicated typography, multi-line layouts, paragraph-level semantics, and bilingual content material (e.g., English-Chinese language).
In apply, this enables customers to generate content material like film posters, presentation slides, storefront scenes, handwritten poetry, and stylized infographics — with crisp textual content that aligns with their prompts.
The AI Affect Sequence Returns to San Francisco – August 5
The following part of AI is right here – are you prepared? Be a part of leaders from Block, GSK, and SAP for an unique have a look at how autonomous brokers are reshaping enterprise workflows – from real-time decision-making to end-to-end automation.
Safe your spot now – house is restricted: https://bit.ly/3GuuPLF
Qwen-Picture’s output examples embrace all kinds of real-world use circumstances:
Advertising & Branding: Bilingual posters with model logos, stylistic calligraphy, and constant design motifs
Presentation Design: Format-aware slide decks with title hierarchies and theme-appropriate visuals
Training: Technology of classroom supplies that includes diagrams and exactly rendered educational textual content
Retail & E-commerce: Storefront scenes the place product labels, signage, and environmental context should all be readable
Inventive Content material: Handwritten poetry, scene narratives, anime-style illustration with embedded story textual content
Customers can work together with the mannequin on the Qwen Chat web site by choosing “Picture Technology” mode from the buttons under the immediate entry subject.
Nonetheless, my transient preliminary checks revealed the textual content and immediate adherence was not noticeably higher than Midjourney, the favored proprietary AI picture generator from the U.S. firm of the identical identify. My session by way of Qwen chat produced a number of errors in immediate comprehension and textual content constancy, a lot to my disappointment, even after repeated makes an attempt and immediate rewording:
But Midjourney solely presents a restricted variety of free generations and requires subscriptions for any extra, in comparison with Qwen Picture, which, because of its open supply licensing and weights posted on Hugging Facemay be adopted by any enterprise or third-party supplier free-of-charge.
Licensing and availability
Qwen-Picture is distributed below the Apache 2.0 license, permitting industrial and non-commercial use, redistribution, and modification — although attribution and inclusion of the license textual content are required for spinoff works.
This will likely make it enticing to enterprises on the lookout for an open supply picture technology instrument to make use of for making inside or external-facing collateral like flyers, adverts, notices, newsletters, and different digital communications.
However the truth that the mannequin’s coaching knowledge stays a tightly guarded secret — like with most different main AI picture mills — might bitter some enterprises on the thought of utilizing it.
Qwen, not like Adobe Firefly or OpenAI’s GPT-4o native picture technology, for instance, doesn’t supply indemnification for industrial makes use of of its product (i.e., if a person will get sued for copyright infringement, Adobe and OpenAI will assist assist them in courtroom).
The mannequin and related belongings — together with demo notebooks, analysis instruments, and fine-tuning scripts — can be found by way of a number of repositories:
As well as, a stay analysis portal referred to as AI Area permits customers to match picture generations in pairwise rounds, contributing to a public Elo-style leaderboard.
Coaching and improvement
Behind Qwen-Picture’s efficiency is an in depth coaching course of grounded in progressive studying, multi-modal activity alignment, and aggressive knowledge curation, in line with the technical paper the analysis crew launched as we speak.
The coaching corpus contains billions of image-text pairs sourced from 4 domains: pure imagery, human portraits, inventive and design content material (comparable to posters and UI layouts), and artificial text-focused knowledge. The Qwen Group didn’t specify the scale of the coaching knowledge corpus, except for “billions of image-text pairs.” They did present a breakdown of the tough proportion of every class of content material it included:
Nature: ~55%
Design (UI, posters, artwork): ~27%
Folks (portraits, human exercise): ~13%
Artificial textual content rendering knowledge: ~5%
Notably, Qwen emphasizes that each one artificial knowledge was generated in-house, and no pictures created by different AI fashions had been used. Regardless of the detailed curation and filtering phases described, the documentation doesn’t make clear whether or not any of the info was licensed or drawn from public or proprietary datasets.
Not like many generative fashions that exclude artificial textual content as a consequence of noise dangers, Qwen-Picture makes use of tightly managed artificial rendering pipelines to enhance character protection — particularly for low-frequency characters in Chinese language.
A curriculum-style technique is employed: the mannequin begins with easy captioned pictures and non-text content material, then advances to layout-sensitive textual content eventualities, mixed-language rendering, and dense paragraphs. This gradual publicity is proven to assist the mannequin generalize throughout scripts and formatting varieties.
Qwen-Picture integrates three key modules:
Qwen2.5-VL, the multimodal language mannequin, extracts contextual that means and guides technology by way of system prompts.
VAE Encoder/Decoder, educated on high-resolution paperwork and real-world layouts, handles detailed visible representations, particularly small or dense textual content.
MMDiT, the diffusion mannequin spine, coordinates joint studying throughout picture and textual content modalities. A novel MSRoPE (Multimodal Scalable Rotary Positional Encoding) system improves spatial alignment between tokens.
Collectively, these elements enable Qwen-Picture to function successfully in duties that contain picture understanding, technology, and exact enhancing.
Efficiency benchmarks
Qwen-Picture was evaluated towards a number of public benchmarks:
GenEval and DPG for prompt-following and object attribute consistency
OneIG-Bench and TIIF for compositional reasoning and structure constancy
CVTG-2K, ChineseWord, and LongText-Bench for textual content rendering, particularly in multilingual contexts
In practically each case, Qwen-Picture both matches or surpasses present closed-source fashions like GPT Picture 1 (Excessive), Seedream 3.0, and FLUX.1 Kontext (Professional). Notably, its efficiency on Chinese language textual content rendering was considerably higher than all in contrast programs.
On the general public AI Area leaderboard — primarily based on 10,000+ human pairwise comparisons — Qwen-Picture ranks third general and is the highest open-source mannequin.
Implications for enterprise technical decision-makers
For enterprise AI groups managing complicated multimodal workflows, Qwen-Picture introduces a number of purposeful benefits that align with the operational wants of various roles.
These managing the lifecycle of vision-language fashions — from coaching to deployment — will discover worth in Qwen-Picture’s constant output high quality and its integration-ready elements. The open-source nature reduces licensing prices, whereas the modular structure (Qwen2.5-VL + VAE + MMDiT) facilitates adaptation to customized datasets or fine-tuning for domain-specific outputs.
The curriculum-style coaching knowledge and clear benchmark outcomes assist groups consider health for function. Whether or not deploying advertising visuals, doc renderings, or e-commerce product graphics, Qwen-Picture permits fast experimentation with out proprietary constraints.
Engineers tasked with constructing AI pipelines or deploying fashions throughout distributed programs will admire the detailed infrastructure documentation. The mannequin has been educated utilizing a Producer-Client structure, helps scalable multi-resolution processing (256p to 1328p), and is constructed to run with Megatron-LM and tensor parallelism. This makes Qwen-Picture a candidate for deployment in hybrid cloud environments the place reliability and throughput matter.
Furthermore, assist for image-to-image enhancing workflows (TI2I) and task-specific prompts allows its use in real-time or interactive functions.
Professionals targeted on knowledge ingestion, validation, and transformation can use Qwen-Picture as a instrument to generate artificial datasets for coaching or augmenting laptop imaginative and prescient fashions. Its capacity to generate high-resolution pictures with embedded, multilingual annotations can enhance efficiency in downstream OCR, object detection, or structure parsing duties.
Since Qwen-Picture was additionally educated to keep away from artifacts like QR codes, distorted textual content, and watermarks, it presents higher-quality artificial enter than many public fashions — serving to enterprise groups protect coaching set integrity.
Searching for suggestions and alternatives to collaborate
The Qwen Group emphasizes openness and neighborhood collaboration within the mannequin’s launch.
Builders are inspired to check and fine-tune Qwen-Picture, supply pull requests, and take part within the analysis leaderboard. Suggestions on textual content rendering, enhancing constancy, and multilingual use circumstances will form future iterations.
With a said aim to “decrease the technical boundaries to visible content material creation,” the crew hopes Qwen-Picture will serve not simply as a mannequin, however as a basis for additional analysis and sensible deployment throughout industries.
Every day insights on enterprise use circumstances with VB Every day
If you wish to impress your boss, VB Every day has you coated. We provide the inside scoop on what corporations are doing with generative AI, from regulatory shifts to sensible deployments, so you’ll be able to share insights for max ROI.
Thanks for subscribing. Try extra VB newsletters right here.
An error occured.
