ReMe/bench
jinli.yl 327dc58f70 feat(bench): add HaluMem dataset statistics analyzer and update LLM concurrency control
- Add new analyze_dataset_stats.py script for comprehensive HaluMem dataset analysis
- Include statistics for user sessions, dialogues, content lengths and chunk distributions
- Replace rate limiting with concurrency control in BaseLLM using semaphore mechanism
- Update configuration to use max_concurrency instead of max_rps and rps_window
- Modify dialogue formatting to include only user messages in evaluation
- Add percentile calculations and detailed content size distribution metrics
- Implement session splitting logic based on character length thresholds
- Provide per-user statistics and summary tables for dataset analysis
- Refactor BaseLLM to use internal _chat_impl and _stream_chat_impl methods
- Remove rate limiting locks and timestamps from LLM initialization
- Add command-line interface for dataset statistics analysis tool
2026-01-14 10:14:35 +08:00
..
halumem feat(bench): add HaluMem dataset statistics analyzer and update LLM concurrency control 2026-01-14 10:14:35 +08:00
eval_reme_old.py feat(benchmark): add HaluMem evaluation suite with ReMe integration 2026-01-10 22:11:20 +08:00