Qt AI Assistant v0.9 Released – Deploy LLMs Locally and Enjoy the Upgraded User Experience

April 16, 2025 by Peter Schneider | Comments

​2025年4月16日：彼得·施耐德|评论

With the 0.9 release, you can unshackle yourself from cloud LLM providers, at least for code completion. We support CodeLlama-7B-QML and DeepSeekCoder v2 Lite now. You can run them with Ollama, the LLM self-hosting technology, on your computer with a few clicks and a single CLI command.

使用0.9版本，可以从云LLM提供商中解放出来，至少在代码完成方面是这样。我们现在支持CodeLlama-7B-QML和DeepSeekCoder v2 Lite。只需点击几下并使用一个CLI命令，就可以在计算机上使用LLM自托管技术Ollama运行它们。

Simultaneously with this latest Qt AI Assistant release, we are making our most powerful fine-tuned models available to everybody on HuggingFace and Ollama. We are releasing CodeLlama-7B-QML and CodeLlama-13B-QML. These models have been trained on over 5000 QML code snippets, up from 4000 previously. In addition, we improved the training data to do a better job of placing closing brackets. CodeLlama-7B-QML performs code completion at similar levels to Claude 3.7 Sonnet according to our QML100FIM benchmark. DeepSeekCoder v2 Lite performs code completion at the quality of GPT4o (stay tuned for a blog post on the latest benchmarking results).

在发布最新Qt AI Assistant的同时，我们正在向HuggingFace和Ollama上的每个人提供我们最强大的微调模型。我们正在发布CodeLlama-7B-QML和CodeLlama-13B-QML。这些模型已经在5000多个QML代码片段上进行了训练，而之前只有4000个。此外，我们改进了训练数据，以便更好地放置括号。根据我们的QML100FIM基准测试，CodeLlama-7B-QML以与Claude 3.7 Sonnet类似的级别执行代码完成。DeepSeekCoder v2 Lite以GPT4o的质量执行代码完成（请继续关注有关最新基准测试结果的博客文章）。

Qt AI Assistant v0.9 Experimental includes many new features and usability improvements such as text streaming of responses to prompts, creation of inline code comments, and Google Test creation for C++ code.

Qt AI Assistant v0.9 Experimental包括许多新功能和可用性改进，如对提示的响应的文本流、内联代码注释的创建以及C++代码的Google测试创建。

Text Streaming

文本流

We have made a lot of usability improvements in this release. The biggest of them is handling responses from LLMs as a text stream in the inline prompt window. Instead of waiting for the response from the LLM to be complete before displaying the content, the AI Assistant is publishing the content now as it comes in. This means significantly lower waiting times before you get your coding assistance. While refactoring our code for text streaming, we also added syntax highlighting to make any code in the suggestion easier to read.

我们在这个版本中做了很多可用性改进。其中最大的一个是在内联提示窗口中以文本流的形式处理来自LLM的响应。AI Assistant现在发布内容，而不是在显示内容之前等待LLM的响应完成。这意味着在获得编码帮助之前，等待时间大大缩短。在重构文本流代码的同时，我们还添加了语法高亮显示，使建议中的任何代码都更容易阅读。

Google Test Creation

Google测试创建

While our focus on the Qt AI Assistant remains, for the time being, on QML and UI development, based on early user feedback, we added support for creating Google Test unit tests for C++ code.

虽然我们目前仍将重点放在Qt AI Assistant上，但基于早期用户反馈，我们增加了对为C++代码创建Google Test单元测试的支持。

Inline Comments

行内注释

The Qt AI Assistant can now generate inline comments for your QML and C++ code, improving maintainability and readability. You can apply the comments to your code with a single click.

Qt AI Assistant现在可以为QML和C++代码生成内联注释，从而提高了可维护性和可读性。只需单击一下，就可以将注释应用于代码。

How to Upgrade

如何升级

The Qt AI Assistant uses the latest and greatest capabilities from Qt Creator. You need to upgrade to Qt Creator release 16.0.1 to update the Qt AI Assistant to v0.9.

​Qt AI Assistant使用Qt Creator的最新和最强大的功能。需要升级到Qt Creator 16.0.1版，才能将Qt AI Assistant更新到v0.9。

If you are using the Qt AI Assistant already, you can click on the Update button in the Extensions view once you have upgraded to Qt Creator 16.0.1.

如果已经在使用Qt AI助手，则可以在升级到Qt Creator 16.0.1后单击Extensions视图中的Update按钮。

If you are new to the Qt AI Assistant, you need to activate first the use of external repositories in the extension view for fetching of new extensions such as the Qt AI Assistant.

如果是Qt AI Assistant的新手，需要首先在扩展视图中激活外部存储库的使用，以获取新的扩展，如Qt AI Assistant。

 

If you haven't yet, there will never be a better time to try out the Qt AI Assistant than now.

如果还没有，那么现在是尝试Qt AI助手的最佳时机。

Meanwhile... the following smaller enhancements have been made in the Qt AI Assistant 0.9 release:

与此同时。。。Qt AI Assistant 0.9版本中进行了以下较小的增强：

• CodeLlama-13B-QML over Ollama support as LLM configuration
• 基于Ollama的CodeLlama-13B-QML支持LLM配置
• Prompt optimisation for OpenAI GPT4o for /fix and /qtest
• OpenAI GPT4o快速优化/fix和/qtest
• Improved placement of the inline prompt window in visible position
• 改进了内联提示窗口在可见位置的放置