交互式AI
项目简介：交互式人工智能允许用户将知识与算法等技术结合并给予用户理解的合理反馈，从而使用人工智能技术更加方便、高效。在理解高维投影这类工作当中，我们尝试提出交互式推荐算法将用户知识引入到降维结果迭代当中，从而增强高维投影可解释性。我们提出了一种基于锚动图驱动的动态文字智能可视化构建方式，用户可以实现了非文字物体向文字的动作迁移。我们也探索了基于图神经网络的可视分析系统中用户意图理解框架，可以根据用户交互历史归纳出用户探索分析过程中的意图。我们结合深度学习探索了在用户分析多视图可视化界面时的交互推荐问题。另外，我们也探索了交互式强化学习对优化奖励函数选择的作用。
Project Introduction: Interactive AI allows users to combine knowledge with algorithmic and other technical techniques, and provides users with reasonable feedback to enhance the convenience and efficiency of using AI technology. In the task of understanding high-dimensional projection, we attempt to propose an interactive recommendation algorithm to introduce user knowledge into the iterative updates of dimensional reduction results, thereby enhancing the interpretability of high-dimensional projection. We propose a dynamic text intelligent visualization construction method based on anchor-driven graph, allowing users to achieve action transfer from non-text objects to text. We also explore a user intent understanding framework in the visual analysis system based on graph neural networks, which can induce user intent during the exploration and analysis process based on their interaction history. We combine deep learning to explore the problem of interactive recommendation when users analyze multi-view visualization interfaces [1]. Additionally, we also explore the role of interactive reinforcement learning in optimizing reward function selection.
相关发表
  • ChartInsighter: An Approach for Mitigating Hallucination in Time-series Chart Summary Generation with A Benchmark Dataset.
    Fen Wang, Bomiao Wang, Xueli Shu, Zhen Liu, Zekai Shao, Chao Liu, Siming Chen*.
    IEEE Transactions on Visualization and Computer Graphics (IEEE PacificVis'25), Accepted, 2025.
  • Fine-tuned large language model for visualization system: A study on self-regulated learning in education.
    Lin Gao, Jing Lu, Zekai Shao, Ziyue Lin, Shengbin Yue, Chiokit Ieong, Yi Sun, Rory James Zauner, Zhongyu Wei, Siming Chen*.
    IEEE Transactions on Visualization and Computer Graphics (IEEE VIS24), Accepted, 2025.
  • LightVA: Lightweight visual analytics with LLM agent-based task planning and execution.
    Yuheng Zhao, Junjie Wang, Linbin Xiang, Xiaowen Zhang, Zifei Guo, Cagatay Turkay, Yu Zhang, Siming Chen*.
    IEEE Transactions on Visualization and Computer Graphics, Accepted, 2024.
  • LEVA: Using large language models to enhance visual analytics.
    Yuheng Zhao, Yixing Zhang, Yu Zhang, Xinyi Zhao, Junjie Wang, Zekai Shao, Cagatay Turkay, Siming Chen*.
    IEEE Transactions on Visualization and Computer Graphics, Accepted, 2024.
  • Interactive Visual Analytics for Reward Function Setting of Reinforcement Learning: A Case Study of Soccer Games.
    Yihang Hu, Weixuan Song, Xingui Lai, Jie Li, Siming Chen*.
    VINCI (Honorable mention of best paper award) 2024: 26:1.
  • Graph-Neural-Network-Based User Intent Understanding for Visual Analytics.
    Yue Wang, Yusheng Qi, Xiaolong Luke Zhang, Siming Chen*.
    In Proceedings of IEEE Pacific Visualization Conference (PacificVis 2024), pages 11-21, Tokyo, Japan, 2024.
  • TopicRefiner: Coherence-Guided Steerable LDA for Visual Topic Enhancement.
    Huan Yang, Jie Li, Siming Chen*.
    IEEE Trans. Vis. Comput. Graph. 30(8): 4542-4557, 2024.
  • Intelligent visualization and visual analytics.
    Jun Tao, Yu Zhang, Qing Chen, Can Liu, Siming Chen, Xiaoru Yuan.
    Journal of Image and Graphics, in Chinese, 28(06):1909-1926, 2023.
  • Diverse Interaction Recommendation for Public Users Exploring Multi-view Visualization using Deep Learning.
    Yixuan Li, Yusheng Qi, Yang Shi, Qing Chen, Nan Cao, Siming Chen*.
    IEEE Transactions on Visualization and Computer Graphics (VIS'22), Accepted, 2023.
    | Paper | pdf (5.8MB)
  • OneLabeler: A Flexible System for Building Data Labeling Tools.
    Yu Zhang, Yun Wang, Haidong Zhang, Bin Zhu, Siming Chen, Dongmei Zhang.
    ACM CHI Conference on Human Factors in Computing Systems (ACM CHI'22), 93: 1-22, 2022.
    | Paper | pdf (8.4MB) | Video | mp4 (21.2MB) | Code | OneLabeler
  • Seeking patterns of visual pattern discovery for knowledge building.
    Natalia Andrienko, Gennady Andrienko, Siming Chen, and Brian Fisher.
    Computer Graphics Forum, 2022, Accepted.
    | Paper | pdf (30.1MB)
  • A hybrid prediction and search approach for flexible and efficient exploration of big data.
    Jie Li, Yongjian Sun, Zhenhuan Lei, Siming Chen, Gennady Andrienko, Natalia Andrienko, Wei Chen.
    Journal of Visualization, 2022, Accepted.
    | Paper | pdf (2.8MB)
  • Exploring Multi-dimensional Data via Subset Embedding.
    Peng Xie, Wenyuan Tao, Jie Li, Wentao Huang, Siming Chen.
    Computer Graphics Forum (EuroVis'21), 40(3): 75-86, 2021.
    | Paper | pdf (5.7MB)
  • 可视化与人工智能交叉研究综述
    夏佳志, 李杰, 陈思明, 秦红星, 刘世霞.
    中国科学: 信息科学, 2021.
    | Paper | pdf (3.51MB)