mirror of https://github.com/corca-ai/EVAL
Merge branch 'main' into fix/editor-write-prompt
hanchchch
1 year ago
commit
c0ef2c5ef1
@ -0,0 +1,38 @@
|
||||
---
|
||||
name: Bug report
|
||||
about: Create a report to help us improve
|
||||
title: ''
|
||||
labels: ''
|
||||
assignees: ''
|
||||
|
||||
---
|
||||
|
||||
**Describe the bug**
|
||||
A clear and concise description of what the bug is.
|
||||
|
||||
**To Reproduce**
|
||||
Steps to reproduce the behavior:
|
||||
1. Go to '...'
|
||||
2. Click on '....'
|
||||
3. Scroll down to '....'
|
||||
4. See error
|
||||
|
||||
**Expected behavior**
|
||||
A clear and concise description of what you expected to happen.
|
||||
|
||||
**Screenshots**
|
||||
If applicable, add screenshots to help explain your problem.
|
||||
|
||||
**Desktop (please complete the following information):**
|
||||
- OS: [e.g. iOS]
|
||||
- Browser [e.g. chrome, safari]
|
||||
- Version [e.g. 22]
|
||||
|
||||
**Smartphone (please complete the following information):**
|
||||
- Device: [e.g. iPhone6]
|
||||
- OS: [e.g. iOS8.1]
|
||||
- Browser [e.g. stock browser, safari]
|
||||
- Version [e.g. 22]
|
||||
|
||||
**Additional context**
|
||||
Add any other context about the problem here.
|
||||
@ -0,0 +1,20 @@
|
||||
---
|
||||
name: Feature request
|
||||
about: Suggest an idea for this project
|
||||
title: ''
|
||||
labels: ''
|
||||
assignees: ''
|
||||
|
||||
---
|
||||
|
||||
**Is your feature request related to a problem? Please describe.**
|
||||
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
|
||||
|
||||
**Describe the solution you'd like**
|
||||
A clear and concise description of what you want to happen.
|
||||
|
||||
**Describe alternatives you've considered**
|
||||
A clear and concise description of any alternative solutions or features you've considered.
|
||||
|
||||
**Additional context**
|
||||
Add any other context or screenshots about the feature request here.
|
||||
@ -0,0 +1,11 @@
|
||||
## :pushpin: Type of PR
|
||||
|
||||
<!-- _Bugfix, Feature, Code style update (formatting, local variables), Refactoring (no functional changes, no api changes), Build related changes, CI related changes, Other..._ -->
|
||||
|
||||
## :recycle: Current situation
|
||||
|
||||
<!-- _Describe the current situation. Explain current problems, if there are any. Be as descriptive as possible (e.g., including examples or code snippets)._ -->
|
||||
|
||||
## :bulb: Proposed solution
|
||||
|
||||
<!-- _Describe the proposed solution and changes. How does it affect the project? How does it affect the internal structure (e.g., refactorings)?_ -->
|
||||
@ -0,0 +1,137 @@
|
||||
# Contributing to CONTRIBUTING.md
|
||||
|
||||
First off, thanks for taking the time to contribute! ❤️
|
||||
|
||||
All types of contributions are encouraged and valued. See the [Table of Contents](#table-of-contents) for different ways to help and details about how this project handles them. Please make sure to read the relevant section before making your contribution. It will make it a lot easier for us maintainers and smooth out the experience for all involved. The community looks forward to your contributions. 🎉
|
||||
|
||||
> And if you like the project, but just don't have time to contribute, that's fine. There are other easy ways to support the project and show your appreciation, which we would also be very happy about:
|
||||
> - Star the project
|
||||
> - Tweet about it
|
||||
> - Refer this project in your project's readme
|
||||
> - Mention the project at local meetups and tell your friends/colleagues
|
||||
|
||||
|
||||
## Table of Contents
|
||||
|
||||
- [Code of Conduct](#code-of-conduct)
|
||||
- [I Have a Question](#i-have-a-question)
|
||||
- [I Want To Contribute](#i-want-to-contribute)
|
||||
- [Reporting Bugs](#reporting-bugs)
|
||||
- [Suggesting Enhancements](#suggesting-enhancements)
|
||||
- [Your First Code Contribution](#your-first-code-contribution)
|
||||
- [Improving The Documentation](#improving-the-documentation)
|
||||
- [Styleguides](#styleguides)
|
||||
- [Commit Messages](#commit-messages)
|
||||
- [Join The Project Team](#join-the-project-team)
|
||||
|
||||
|
||||
## Code of Conduct
|
||||
|
||||
This project and everyone participating in it is governed by the
|
||||
[CONTRIBUTING.md Code of Conduct](blob/master/CODE_OF_CONDUCT.md).
|
||||
By participating, you are expected to uphold this code. Please report unacceptable behavior
|
||||
to <>.
|
||||
|
||||
|
||||
## I Have a Question
|
||||
|
||||
> If you want to ask a question, we assume that you have read the available [Documentation]().
|
||||
|
||||
Before you ask a question, it is best to search for existing [Issues](/issues) that might help you. In case you have found a suitable issue and still need clarification, you can write your question in this issue. It is also advisable to search the internet for answers first.
|
||||
|
||||
If you then still feel the need to ask a question and need clarification, we recommend the following:
|
||||
|
||||
- Open an [Issue](/issues/new).
|
||||
- Provide as much context as you can about what you're running into.
|
||||
- Provide project and platform versions (nodejs, npm, etc), depending on what seems relevant.
|
||||
|
||||
We will then take care of the issue as soon as possible.
|
||||
|
||||
|
||||
|
||||
## I Want To Contribute
|
||||
|
||||
> ### Legal Notice
|
||||
> When contributing to this project, you must agree that you have authored 100% of the content, that you have the necessary rights to the content and that the content you contribute may be provided under the project license.
|
||||
|
||||
### Reporting Bugs
|
||||
|
||||
|
||||
#### Before Submitting a Bug Report
|
||||
|
||||
A good bug report shouldn't leave others needing to chase you up for more information. Therefore, we ask you to investigate carefully, collect information and describe the issue in detail in your report. Please complete the following steps in advance to help us fix any potential bug as fast as possible.
|
||||
|
||||
- Make sure that you are using the latest version.
|
||||
- Determine if your bug is really a bug and not an error on your side e.g. using incompatible environment components/versions (Make sure that you have read the [documentation](). If you are looking for support, you might want to check [this section](#i-have-a-question)).
|
||||
- To see if other users have experienced (and potentially already solved) the same issue you are having, check if there is not already a bug report existing for your bug or error in the [bug tracker](issues?q=label%3Abug).
|
||||
- Also make sure to search the internet (including Stack Overflow) to see if users outside of the GitHub community have discussed the issue.
|
||||
- Collect information about the bug:
|
||||
- Stack trace (Traceback)
|
||||
- OS, Platform and Version (Windows, Linux, macOS, x86, ARM)
|
||||
- Version of the interpreter, compiler, SDK, runtime environment, package manager, depending on what seems relevant.
|
||||
- Possibly your input and the output
|
||||
- Can you reliably reproduce the issue? And can you also reproduce it with older versions?
|
||||
|
||||
|
||||
#### How Do I Submit a Good Bug Report?
|
||||
|
||||
> You must never report security related issues, vulnerabilities or bugs including sensitive information to the issue tracker, or elsewhere in public. Instead sensitive bugs must be sent by email to <>.
|
||||
|
||||
|
||||
We use GitHub issues to track bugs and errors. If you run into an issue with the project:
|
||||
|
||||
- Open an [Issue](/issues/new). (Since we can't be sure at this point whether it is a bug or not, we ask you not to talk about a bug yet and not to label the issue.)
|
||||
- Explain the behavior you would expect and the actual behavior.
|
||||
- Please provide as much context as possible and describe the *reproduction steps* that someone else can follow to recreate the issue on their own. This usually includes your code. For good bug reports you should isolate the problem and create a reduced test case.
|
||||
- Provide the information you collected in the previous section.
|
||||
|
||||
Once it's filed:
|
||||
|
||||
- The project team will label the issue accordingly.
|
||||
- A team member will try to reproduce the issue with your provided steps. If there are no reproduction steps or no obvious way to reproduce the issue, the team will ask you for those steps and mark the issue as `needs-repro`. Bugs with the `needs-repro` tag will not be addressed until they are reproduced.
|
||||
- If the team is able to reproduce the issue, it will be marked `needs-fix`, as well as possibly other tags (such as `critical`), and the issue will be left to be [implemented by someone](#your-first-code-contribution).
|
||||
|
||||
|
||||
|
||||
|
||||
### Suggesting Enhancements
|
||||
|
||||
This section guides you through submitting an enhancement suggestion for CONTRIBUTING.md, **including completely new features and minor improvements to existing functionality**. Following these guidelines will help maintainers and the community to understand your suggestion and find related suggestions.
|
||||
|
||||
|
||||
#### Before Submitting an Enhancement
|
||||
|
||||
- Make sure that you are using the latest version.
|
||||
- Read the [documentation]() carefully and find out if the functionality is already covered, maybe by an individual configuration.
|
||||
- Perform a [search](/issues) to see if the enhancement has already been suggested. If it has, add a comment to the existing issue instead of opening a new one.
|
||||
- Find out whether your idea fits with the scope and aims of the project. It's up to you to make a strong case to convince the project's developers of the merits of this feature. Keep in mind that we want features that will be useful to the majority of our users and not just a small subset. If you're just targeting a minority of users, consider writing an add-on/plugin library.
|
||||
|
||||
|
||||
#### How Do I Submit a Good Enhancement Suggestion?
|
||||
|
||||
Enhancement suggestions are tracked as [GitHub issues](/issues).
|
||||
|
||||
- Use a **clear and descriptive title** for the issue to identify the suggestion.
|
||||
- Provide a **step-by-step description of the suggested enhancement** in as many details as possible.
|
||||
- **Describe the current behavior** and **explain which behavior you expected to see instead** and why. At this point you can also tell which alternatives do not work for you.
|
||||
- You may want to **include screenshots and animated GIFs** which help you demonstrate the steps or point out the part which the suggestion is related to. You can use [this tool](https://www.cockos.com/licecap/) to record GIFs on macOS and Windows, and [this tool](https://github.com/colinkeenan/silentcast) or [this tool](https://github.com/GNOME/byzanz) on Linux.
|
||||
- **Explain why this enhancement would be useful** to most CONTRIBUTING.md users. You may also want to point out the other projects that solved it better and which could serve as inspiration.
|
||||
|
||||
|
||||
|
||||
### Your First Code Contribution
|
||||
|
||||
|
||||
### Improving The Documentation
|
||||
|
||||
|
||||
## Styleguides
|
||||
### Commit Messages
|
||||
|
||||
|
||||
## Join The Project Team
|
||||
|
||||
|
||||
|
||||
## Attribution
|
||||
This guide is based on the **contributing.md**. [Make your own](https://contributing.md/)!
|
||||
@ -0,0 +1,21 @@
|
||||
MIT License
|
||||
|
||||
Copyright (c) 2023 Corca
|
||||
|
||||
Permission is hereby granted, free of charge, to any person obtaining a copy
|
||||
of this software and associated documentation files (the "Software"), to deal
|
||||
in the Software without restriction, including without limitation the rights
|
||||
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
||||
copies of the Software, and to permit persons to whom the Software is
|
||||
furnished to do so, subject to the following conditions:
|
||||
|
||||
The above copyright notice and this permission notice shall be included in all
|
||||
copies or substantial portions of the Software.
|
||||
|
||||
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
||||
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
||||
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
||||
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
||||
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
||||
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
||||
SOFTWARE.
|
||||
@ -0,0 +1,62 @@
|
||||
import os
|
||||
import re
|
||||
from pathlib import Path
|
||||
from typing import Dict, List
|
||||
|
||||
from fastapi.templating import Jinja2Templates
|
||||
|
||||
from core.agents.manager import AgentManager
|
||||
from core.handlers.base import BaseHandler, FileHandler, FileType
|
||||
from core.handlers.dataframe import CsvToDataframe
|
||||
from core.tools.base import BaseToolSet
|
||||
from core.tools.cpu import ExitConversation, RequestsGet
|
||||
from core.tools.editor import CodeEditor
|
||||
from core.tools.terminal import Terminal
|
||||
from core.upload import StaticUploader
|
||||
from env import settings
|
||||
|
||||
BASE_DIR = Path(os.path.dirname(os.path.dirname(os.path.abspath(__file__))))
|
||||
os.chdir(BASE_DIR / settings["PLAYGROUND_DIR"])
|
||||
|
||||
|
||||
toolsets: List[BaseToolSet] = [
|
||||
Terminal(),
|
||||
CodeEditor(),
|
||||
RequestsGet(),
|
||||
ExitConversation(),
|
||||
]
|
||||
handlers: Dict[FileType, BaseHandler] = {FileType.DATAFRAME: CsvToDataframe()}
|
||||
|
||||
if settings["USE_GPU"]:
|
||||
import torch
|
||||
|
||||
from core.handlers.image import ImageCaptioning
|
||||
from core.tools.gpu import (
|
||||
ImageEditing,
|
||||
InstructPix2Pix,
|
||||
Text2Image,
|
||||
VisualQuestionAnswering,
|
||||
)
|
||||
|
||||
if torch.cuda.is_available():
|
||||
toolsets.extend(
|
||||
[
|
||||
Text2Image("cuda"),
|
||||
ImageEditing("cuda"),
|
||||
InstructPix2Pix("cuda"),
|
||||
VisualQuestionAnswering("cuda"),
|
||||
]
|
||||
)
|
||||
handlers[FileType.IMAGE] = ImageCaptioning("cuda")
|
||||
|
||||
agent_manager = AgentManager.create(toolsets=toolsets)
|
||||
|
||||
file_handler = FileHandler(handlers=handlers, path=BASE_DIR)
|
||||
|
||||
templates = Jinja2Templates(directory=BASE_DIR / "api" / "templates")
|
||||
|
||||
uploader = StaticUploader.from_settings(
|
||||
settings, path=BASE_DIR / "static", endpoint="static"
|
||||
)
|
||||
|
||||
reload_dirs = [BASE_DIR / "core", BASE_DIR / "api"]
|
||||
@ -0,0 +1,83 @@
|
||||
<!DOCTYPE html>
|
||||
<html lang="en">
|
||||
<head>
|
||||
<meta charset="utf-8" />
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1" />
|
||||
<title>EVAL {% block title %}{% endblock %}</title>
|
||||
<link href="{{ url_for('static', path='/styles.css') }}" rel="stylesheet" />
|
||||
<link
|
||||
href="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0-alpha3/dist/css/bootstrap.min.css"
|
||||
rel="stylesheet"
|
||||
integrity="sha384-KK94CHFLLe+nY2dmCWGMq91rCGa5gtU4mk92HdvYe+M/SXH301p5ILy+dN9+nJOZ"
|
||||
crossorigin="anonymous"
|
||||
/>
|
||||
<link rel="icon" href="{{ url_for('static', path='/eval.png') }}" />
|
||||
{% block head %} {% endblock %}
|
||||
</head>
|
||||
<body>
|
||||
<header
|
||||
class="d-flex flex-wrap justify-content-center py-3 mb-4 border-bottom"
|
||||
>
|
||||
<a
|
||||
href="/"
|
||||
class="d-flex align-items-center mb-3 mb-md-0 me-md-auto link-body-emphasis text-decoration-none"
|
||||
>
|
||||
<svg class="bi me-2" width="40" height="32">
|
||||
<use xlink:href="#bootstrap"></use>
|
||||
</svg>
|
||||
<img
|
||||
class="logo"
|
||||
src="{{ url_for('static', path='/eval.png') }}"
|
||||
alt="logo"
|
||||
/>
|
||||
<span class="fs-4">EVAL</span>
|
||||
</a>
|
||||
<ul class="nav nav-pills">
|
||||
<li class="nav-item">
|
||||
<a
|
||||
href="https://github.com/corca-ai/EVAL"
|
||||
class="nav-link"
|
||||
target="_blank"
|
||||
>Github</a
|
||||
>
|
||||
</li>
|
||||
</ul>
|
||||
</header>
|
||||
<div class="d-flex flex-row">
|
||||
<!-- <div
|
||||
class="d-flex flex-column flex-shrink-0 p-3 bg-body-tertiary"
|
||||
style="width: 240px; height: 80vh"
|
||||
>
|
||||
<ul id="nav-sidebar" class="nav nav-pills flex-column mb-auto">
|
||||
<li class="nav-item">
|
||||
<a href="/" class="nav-link link-body-emphasis">
|
||||
<svg class="bi pe-none me-2" width="16" height="16">
|
||||
<use xlink:href="#home"></use>
|
||||
</svg>
|
||||
Execute
|
||||
</a>
|
||||
</li>
|
||||
<li>
|
||||
<a href="/dashboard" class="nav-link link-body-emphasis">
|
||||
<svg class="bi pe-none me-2" width="16" height="16">
|
||||
<use xlink:href="#speedometer2"></use>
|
||||
</svg>
|
||||
Dashboard
|
||||
</a>
|
||||
</li>
|
||||
</ul>
|
||||
<hr />
|
||||
</div> -->
|
||||
|
||||
<div class="w-100">
|
||||
<div class="container">{% block content %}{% endblock %}</div>
|
||||
</div>
|
||||
</div>
|
||||
<script
|
||||
src="https://cdn.jsdelivr.net/npm/bootstrap@5.3.0-alpha3/dist/js/bootstrap.bundle.min.js"
|
||||
integrity="sha384-ENjdO4Dr2bkBIFxQpeoTz1HIcje39Wm4jDKdf19U8gI4ddQ3GYNS7NTKfAdVQSZe"
|
||||
crossorigin="anonymous"
|
||||
></script>
|
||||
<script src="{{ url_for('static', path='/layout.js') }}"></script>
|
||||
</body>
|
||||
</html>
|
||||
@ -0,0 +1,3 @@
|
||||
{% extends "base.html" %} {% block head %} {% endblock %} {% block content %}
|
||||
<div class="p-3">Work in progress.</div>
|
||||
{% endblock %}
|
||||
@ -0,0 +1,53 @@
|
||||
{% extends "base.html" %} {% block head %}
|
||||
<script src="{{ url_for('static', path='/execute.js') }}"></script>
|
||||
{% endblock %} {% block content %}
|
||||
<div class="container-fluid pb-3">
|
||||
<div class="d-grid gap-3" style="grid-template-columns: 2fr 3fr">
|
||||
<div class="bg-body-tertiary border rounded-3 p-3">
|
||||
<div>
|
||||
<div class="mb-3">
|
||||
<label for="prompt" class="form-label">Prompt</label>
|
||||
<textarea id="prompt" name="prompt" class="form-control"></textarea>
|
||||
</div>
|
||||
<div class="mb-3">
|
||||
<label for="files" class="form-label">Files</label>
|
||||
<input id="files" type="file" class="form-control" />
|
||||
</div>
|
||||
<div class="mb-3">
|
||||
<label for="session" class="form-label">Session</label>
|
||||
<input id="session" name="session" class="form-control" />
|
||||
</div>
|
||||
<button
|
||||
id="submit"
|
||||
type="submit"
|
||||
class="btn btn-primary"
|
||||
onclick="submit(event)"
|
||||
>
|
||||
Submit
|
||||
</button>
|
||||
<button
|
||||
id="submit-loader"
|
||||
class="btn btn-primary disabled"
|
||||
style="display: none"
|
||||
>
|
||||
Submit
|
||||
<div class="spinner-border spinner-border-sm"></div>
|
||||
</button>
|
||||
</div>
|
||||
</div>
|
||||
<div class="bg-body-tertiary border rounded-3 p-2">
|
||||
<div id="actions"></div>
|
||||
<div class="card m-2">
|
||||
<div class="card-body">
|
||||
<div id="answer" class="card-text"></div>
|
||||
<div id="response-files" class="card-text"></div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<script>
|
||||
setRandomSessionId();
|
||||
</script>
|
||||
</div>
|
||||
{% endblock %}
|
||||
@ -0,0 +1,42 @@
|
||||
from celery import Celery
|
||||
from celery.result import AsyncResult
|
||||
|
||||
from api.container import agent_manager
|
||||
from env import settings
|
||||
|
||||
celery_app = Celery(__name__)
|
||||
celery_app.conf.broker_url = settings["CELERY_BROKER_URL"]
|
||||
celery_app.conf.result_backend = settings["CELERY_BROKER_URL"]
|
||||
celery_app.conf.update(
|
||||
task_track_started=True,
|
||||
task_serializer="json",
|
||||
accept_content=["json"], # Ignore other content
|
||||
result_serializer="json",
|
||||
enable_utc=True,
|
||||
)
|
||||
|
||||
|
||||
@celery_app.task(name="task_execute", bind=True)
|
||||
def task_execute(self, session: str, prompt: str):
|
||||
executor = agent_manager.create_executor(session, self)
|
||||
response = executor({"input": prompt})
|
||||
result = {"output": response["output"]}
|
||||
|
||||
previous = AsyncResult(self.request.id)
|
||||
if previous and previous.info:
|
||||
result.update(previous.info)
|
||||
|
||||
return result
|
||||
|
||||
|
||||
def get_task_result(task_id):
|
||||
return AsyncResult(task_id)
|
||||
|
||||
|
||||
def start_worker():
|
||||
celery_app.worker_main(
|
||||
[
|
||||
"worker",
|
||||
"--loglevel=INFO",
|
||||
]
|
||||
)
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 302 KiB |
@ -0,0 +1,14 @@
|
||||
from pathlib import Path
|
||||
|
||||
|
||||
def verify(func):
|
||||
def wrapper(*args, **kwargs):
|
||||
try:
|
||||
filepath = args[0].filepath
|
||||
except AttributeError:
|
||||
raise Exception("This tool doesn't have filepath. Please check your code.")
|
||||
if not str(Path(filepath).resolve()).startswith(str(Path().resolve())):
|
||||
return "You can't access file outside of playground."
|
||||
return func(*args, **kwargs)
|
||||
|
||||
return wrapper
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 362 KiB |
@ -0,0 +1,277 @@
|
||||
const $ = (selector) => document.querySelector(selector);
|
||||
|
||||
const setLoader = (isLoading) => {
|
||||
const button = $("#submit");
|
||||
const loader = $("#submit-loader");
|
||||
if (isLoading) {
|
||||
button.style.display = "none";
|
||||
loader.style.display = "block";
|
||||
} else {
|
||||
button.style.display = "block";
|
||||
loader.style.display = "none";
|
||||
}
|
||||
};
|
||||
|
||||
const setAnswer = (answer, files = []) => {
|
||||
if (answer) {
|
||||
$("#answer").textContent = answer;
|
||||
} else {
|
||||
$("#answer").innerHTML = createSpinner();
|
||||
}
|
||||
|
||||
const filesDiv = $("#response-files");
|
||||
filesDiv.innerHTML = "";
|
||||
files.forEach((file) => {
|
||||
const a = document.createElement("a");
|
||||
a.classList.add("icon-link");
|
||||
a.href = file;
|
||||
a.textContent = file.split("/").pop();
|
||||
a.setAttribute("download", "");
|
||||
filesDiv.appendChild(a);
|
||||
});
|
||||
};
|
||||
|
||||
class EvalApi {
|
||||
constructor({ onComplete, onError, onSettle, onLLMEnd, onToolEnd }) {
|
||||
this.executionId = null;
|
||||
this.pollInterval = null;
|
||||
this.onComplete = (answer, files, info) => {
|
||||
onComplete(answer, files, info);
|
||||
onSettle();
|
||||
};
|
||||
this.onError = (error) => {
|
||||
onError(error);
|
||||
onSettle();
|
||||
};
|
||||
this.onLLMEnd = (info) => {
|
||||
onLLMEnd(info);
|
||||
};
|
||||
this.onToolEnd = (info) => {
|
||||
onToolEnd(info);
|
||||
};
|
||||
}
|
||||
async uploadFiles(rawfiles) {
|
||||
const files = [];
|
||||
|
||||
if (rawfiles.length > 0) {
|
||||
const formData = new FormData();
|
||||
for (let i = 0; i < rawfiles.length; i++) {
|
||||
formData.append("files", rawfiles[i]);
|
||||
}
|
||||
const respone = await fetch("/upload", {
|
||||
method: "POST",
|
||||
body: formData,
|
||||
});
|
||||
const { urls } = await respone.json();
|
||||
files.push(...urls);
|
||||
}
|
||||
|
||||
return files;
|
||||
}
|
||||
|
||||
async execute(prompt, session, files) {
|
||||
try {
|
||||
const response = await fetch("/api/execute/async", {
|
||||
method: "POST",
|
||||
headers: {
|
||||
"Content-Type": "application/json",
|
||||
},
|
||||
body: JSON.stringify({
|
||||
prompt,
|
||||
session,
|
||||
files,
|
||||
}),
|
||||
});
|
||||
if (response.status !== 200) {
|
||||
throw new Error(await response.text());
|
||||
}
|
||||
const { id: executionId } = await response.json();
|
||||
this.executionId = executionId;
|
||||
this.pollInterval = setInterval(this.poll.bind(this), 1000);
|
||||
} catch (e) {
|
||||
clearInterval(this.pollInterval);
|
||||
this.onError(e);
|
||||
}
|
||||
}
|
||||
|
||||
async poll() {
|
||||
try {
|
||||
const response = await fetch(`/api/execute/async/${this.executionId}`, {
|
||||
method: "GET",
|
||||
});
|
||||
if (response.status !== 200) {
|
||||
throw new Error(await response.text());
|
||||
}
|
||||
const { status, result, info } = await response.json();
|
||||
switch (status) {
|
||||
case "PENDING":
|
||||
break;
|
||||
case "FAILURE":
|
||||
throw new Error("Execution failed");
|
||||
case "LLM_END":
|
||||
this.onLLMEnd(info);
|
||||
break;
|
||||
case "TOOL_END":
|
||||
this.onToolEnd(info);
|
||||
break;
|
||||
case "SUCCESS":
|
||||
clearInterval(this.pollInterval);
|
||||
this.onComplete(result.answer, result.files, info);
|
||||
break;
|
||||
}
|
||||
} catch (e) {
|
||||
clearInterval(this.pollInterval);
|
||||
this.onError(e);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
const submit = async () => {
|
||||
setAnswer("");
|
||||
setLoader(true);
|
||||
|
||||
const actions = $("#actions");
|
||||
actions.innerHTML = "";
|
||||
|
||||
let currentActionIndex = 0;
|
||||
|
||||
const onInfo = (info) => {
|
||||
if (currentActionIndex >= info.index) {
|
||||
return;
|
||||
}
|
||||
currentActionIndex = info.index;
|
||||
const w = document.createElement("div");
|
||||
w.innerHTML = createActionCard(
|
||||
info.index,
|
||||
info.action,
|
||||
info.action_input,
|
||||
info.what_i_did,
|
||||
info.plan,
|
||||
info.observation
|
||||
);
|
||||
actions.appendChild(w);
|
||||
};
|
||||
|
||||
const api = new EvalApi({
|
||||
onSettle: () => setLoader(false),
|
||||
onError: (error) => setAnswer(`Error: ${error.message}`, []),
|
||||
onComplete: (answer, files, info) => {
|
||||
setAnswer(answer, files);
|
||||
onInfo(info);
|
||||
},
|
||||
onLLMEnd: onInfo,
|
||||
onToolEnd: onInfo,
|
||||
});
|
||||
|
||||
const prompt = $("#prompt").value;
|
||||
const session = $("#session").value;
|
||||
const files = await api.uploadFiles($("#files").files);
|
||||
|
||||
await api.execute(prompt, session, files);
|
||||
};
|
||||
|
||||
const setRandomSessionId = () => {
|
||||
const sessionId = Math.random().toString(36).substring(2, 15);
|
||||
$("#session").value = sessionId;
|
||||
};
|
||||
|
||||
const createSpinner = () => `
|
||||
<div class="text-center">
|
||||
<div class="spinner-border m-3"></div>
|
||||
</div>
|
||||
`;
|
||||
|
||||
const createActionCard = (
|
||||
index,
|
||||
action,
|
||||
input,
|
||||
whatIdid,
|
||||
plan,
|
||||
observation
|
||||
) => `
|
||||
<div class="accordion m-2">
|
||||
<div class="accordion-item">
|
||||
<h2 class="accordion-header">
|
||||
<button class="accordion-button">
|
||||
<span class="text-secondary">
|
||||
Action #${index}
|
||||
</span>
|
||||
<span class="mx-1">-</span>
|
||||
<span class="fw-bold">
|
||||
${action}
|
||||
</span>
|
||||
</button>
|
||||
</h2>
|
||||
<div class="accordion-collapse collapse show">
|
||||
<div class="accordion-body">
|
||||
<table class="table">
|
||||
<tbody>
|
||||
${
|
||||
action !== "Final Answer"
|
||||
? `<tr>
|
||||
<th style="width: 100px">Input</th>
|
||||
<td><div>${input}</div></td>
|
||||
</tr>`
|
||||
: ""
|
||||
}
|
||||
<tr>
|
||||
<th style="width: 100px">What I Did</th>
|
||||
<td><div>${whatIdid}</div></td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>
|
||||
|
||||
<table class="table">
|
||||
<thead>
|
||||
<tr>
|
||||
<th colspan="2">Plan</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody>
|
||||
${plan
|
||||
.split("- ")
|
||||
.map((p) => p.trim())
|
||||
.filter((p) => p.length > 0)
|
||||
.map(
|
||||
(p) => `
|
||||
<tr>
|
||||
${
|
||||
p.startsWith("[ ]")
|
||||
? `<td><input class="form-check-input" type="checkbox" /></td>
|
||||
<td>${p.replace("[ ]", "")}</td>`
|
||||
: ""
|
||||
}
|
||||
${
|
||||
p.startsWith("[x]")
|
||||
? `<td><input class="form-check-input" type="checkbox" checked/></td>
|
||||
<td>${p.replace("[x]", "")}</td>`
|
||||
: ""
|
||||
}
|
||||
</tr>`
|
||||
)
|
||||
.join("")}
|
||||
</tbody>
|
||||
</table>
|
||||
|
||||
${
|
||||
action !== "Final Answer"
|
||||
? `<table class="table">
|
||||
<thead>
|
||||
<tr>
|
||||
<th colspan="2">Observation</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody>
|
||||
<tr>
|
||||
<td>
|
||||
<div>${observation}</div>
|
||||
</td>
|
||||
</tr>
|
||||
</tbody>
|
||||
</table>`
|
||||
: ""
|
||||
}
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>`;
|
||||
@ -0,0 +1,27 @@
|
||||
const highlightActiveNavItem = () => {
|
||||
const navItems = document.querySelectorAll("#nav-sidebar > li > a");
|
||||
const currentPath = window.location.pathname;
|
||||
navItems.forEach((item) => {
|
||||
if (item.getAttribute("href") === currentPath) {
|
||||
item.classList.add("active");
|
||||
}
|
||||
});
|
||||
};
|
||||
|
||||
highlightActiveNavItem();
|
||||
|
||||
const getNumber = (str) => Number(str.replace("px", ""));
|
||||
|
||||
function expandTextarea(id) {
|
||||
document.getElementById(id).addEventListener(
|
||||
"keyup",
|
||||
function () {
|
||||
this.style.overflow = "hidden";
|
||||
this.style.height =
|
||||
Math.max(getNumber(this.style.height), this.scrollHeight) + "px";
|
||||
},
|
||||
false
|
||||
);
|
||||
}
|
||||
|
||||
expandTextarea("prompt");
|
||||
@ -0,0 +1,7 @@
|
||||
.logo {
|
||||
border-radius: 50%;
|
||||
overflow: hidden;
|
||||
height: 48px;
|
||||
width: 48px;
|
||||
margin-right: 20px;
|
||||
}
|
||||
Loading…
Reference in New Issue