chore: remove benchmark submission issue template and label matcher (#4514)
This commit is contained in:
@@ -1,43 +0,0 @@
|
|||||||
name: Benchmark Submission
|
|
||||||
description: Submit evaluation or benchmark results for a model configuration
|
|
||||||
labels: ["benchmark"]
|
|
||||||
|
|
||||||
body:
|
|
||||||
- type: textarea
|
|
||||||
id: results
|
|
||||||
attributes:
|
|
||||||
label: Results
|
|
||||||
value: |
|
|
||||||
### Model
|
|
||||||
|
|
||||||
Name and provider (e.g., gpt-4o, claude-3.5-sonnet, llama-3.1-70b)
|
|
||||||
|
|
||||||
### Configuration
|
|
||||||
|
|
||||||
```python
|
|
||||||
config = {
|
|
||||||
"llm": {"provider": "...", "config": {"model": "..."}},
|
|
||||||
"vector_store": {"provider": "...", "config": {...}}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
### Dataset
|
|
||||||
|
|
||||||
Which dataset or eval suite did you use?
|
|
||||||
|
|
||||||
### Results
|
|
||||||
|
|
||||||
| Metric | Score |
|
|
||||||
|--------------|-------|
|
|
||||||
| Precision | |
|
|
||||||
| Recall | |
|
|
||||||
| F1 | |
|
|
||||||
| Latency (ms) | |
|
|
||||||
|
|
||||||
### Environment
|
|
||||||
|
|
||||||
- Hardware:
|
|
||||||
- mem0 version:
|
|
||||||
- Python version:
|
|
||||||
validations:
|
|
||||||
required: true
|
|
||||||
@@ -18,5 +18,3 @@ component:
|
|||||||
matcher: "OpenClaw"
|
matcher: "OpenClaw"
|
||||||
- label: "rest-api"
|
- label: "rest-api"
|
||||||
matcher: "REST API"
|
matcher: "REST API"
|
||||||
- label: "benchmark"
|
|
||||||
matcher: "Benchmarks"
|
|
||||||
|
|||||||
Reference in New Issue
Block a user