Skip to content
@xlang-ai

XLANG NLP Lab

Building language model agents that ground language instructions into code or actions executable in real-world environments

Welcome to the Executable Language Grounding (XLANG) Lab! We are part of the HKU NLP Group at the University of Hong Kong. XLang focuses on building language model agents that transform (“grounding”) language instructions into code or actions executable in real-world environments, including databases (data agent), web applications (plugins/web agent), and the physical world (robotic agent) etc,. It lies at the heart of language model agents or natural language interfaces that can interact with and learn from these real-world environments to facilitate human interaction with data analysis, web applications, and robotic instruction through conversation. Recent advances in XLang incorporate techniques such as LLM + external tools, code generation, semantic parsing, and dialog or interactive systems.

Pinned Loading

  1. OSWorld OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Python 1.5k 166

  2. aguvis aguvis Public

    Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    Python 176 11

  3. OpenAgents OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    Python 4.1k 458

  4. instructor-embedding instructor-embedding Public

    [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

    Python 1.9k 141

  5. text2reward text2reward Public

    [ICLR 2024 Spotlight] Code for the paper "Text2Reward: Reward Shaping with Language Models for Reinforcement Learning"

    Jupyter Notebook 141 8

  6. DS-1000 DS-1000 Public

    [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".

    Python 231 26

Repositories

Showing 10 of 18 repositories
  • instructor-embedding Public

    [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

    xlang-ai/instructor-embedding’s past year of commit activity
    Python 1,902 Apache-2.0 141 31 4 Updated Jan 15, 2025
  • OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    xlang-ai/OSWorld’s past year of commit activity
    Python 1,529 Apache-2.0 166 36 0 Updated Jan 14, 2025
  • aguvis Public

    Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    xlang-ai/aguvis’s past year of commit activity
    Python 176 11 8 0 Updated Jan 14, 2025
  • Spider2 Public

    Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    xlang-ai/Spider2’s past year of commit activity
    HTML 264 Apache-2.0 23 25 0 Updated Jan 10, 2025
  • BRIGHT Public

    BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

    xlang-ai/BRIGHT’s past year of commit activity
    Python 66 CC-BY-4.0 3 1 1 Updated Dec 31, 2024
  • text2reward Public

    [ICLR 2024 Spotlight] Code for the paper "Text2Reward: Reward Shaping with Language Models for Reinforcement Learning"

    xlang-ai/text2reward’s past year of commit activity
    Jupyter Notebook 141 8 2 0 Updated Dec 17, 2024
  • EVOR Public
    xlang-ai/EVOR’s past year of commit activity
    Python 54 Apache-2.0 6 3 0 Updated Dec 15, 2024
  • Pai-Megatron-Patch Public Forked from alibaba/Pai-Megatron-Patch

    The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

    xlang-ai/Pai-Megatron-Patch’s past year of commit activity
    Python 0 Apache-2.0 117 0 0 Updated Nov 27, 2024
  • OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    xlang-ai/OpenAgents’s past year of commit activity
    Python 4,088 Apache-2.0 458 10 2 Updated Nov 18, 2024
  • DS-1000 Public

    [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".

    xlang-ai/DS-1000’s past year of commit activity
    Python 231 CC-BY-SA-4.0 26 2 0 Updated Oct 30, 2024

Most used topics

Loading…