Skip to content

Commit

Permalink
Merge remote-tracking branch 'upstream/main' into add-GUI
Browse files Browse the repository at this point in the history
  • Loading branch information
0dm committed Jun 14, 2023
2 parents 4fb0ba5 + 8c1c84b commit 794925c
Showing 1 changed file with 8 additions and 8 deletions.
16 changes: 8 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,24 +2,26 @@

# OpenAdapt: AI-First Process Automation with Transformers

<img width="853" alt="image" src="https://github.com/MLDSAI/OpenAdapt/assets/774615/438e7803-667c-4ce8-a135-1d1e10700ced">

Welcome to OpenAdapt! This Python library implements AI-First Process Automation
with the power of Transformers by:

- Recording screenshots and associated user input
- Aggregating and visualizing user input and recordings for development
- Converting screenshots and user input into tok/enized format
- Converting screenshots and user input into tokenized format
- Generating synthetic input via transformer model completions
- Replaying synthetic input to complete tasks

The goal is similar to that of
[Robotic Process Automation](https://en.wikipedia.org/wiki/Robotic_process_automation),
except that we use transformers instead of conventional RPA tools.

The approach is similar to [adept.ai](https://adept.ai/), with some key differences:
1. Instead of requiring the user to prompt the model directly, we prompt it behind the
scenes by observing the user's activities;
2. We work with all types of desktop applications, not just web apps;
3. We're open source!
The direction is adjacent to [Adept.ai](https://adept.ai/), with some key differences:
1. OpenAdapt is model agnostic;
1. OpenAdapt generates prompts automatically (auto-prompted, not user-prompted);
2. OpenAdapt works with all types of desktop GUIs, including virtualized (e.g. Citrix) and web
3. OpenAdapt is open source! (license TBD, please see https://github.com/MLDSAI/OpenAdapt/issues/246)

## Install

Expand Down Expand Up @@ -95,8 +97,6 @@ More ReplayStrategies coming soon! (see [Contributing](#Contributing)).

## Contributing

### Design

### Problem Statement

Our goal is to automate the task described and demonstrated in a `Recording`.
Expand Down

0 comments on commit 794925c

Please sign in to comment.