github/dbx
4
0 Fork 0
mirror of https://github.com/t8y2/dbx.git synced 2026-11-15 14:52:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,054 Commits 35 Branches 497 Tags
a18b0760574082224baf4685735fae558e59e21e
Commit Graph
625 Commits
Author SHA1 Message Date
t8y2 a18b076057 fix(xugu): qualify schema-aware table selects 2026-06-15 21:06:21 +08:00
Abeautifulsnow c300336281 feat(ai): context window management and token usage tracking 
* @
feat(ai): add conversation context management and token usage tracking (Phase 4)

## Background
Phase 4 of AI agent loop upgrade: token usage extraction from LLM responses,
cost estimation display, and automatic context window management (summarization
when approaching limits).

## Changes

### Backend (Rust)
- New token_usage::TokenUsage — cross-turn token accumulation
- New agent_loop::maybe_compact — proactive context compaction: token estimation
  → cut-point selection → LLM summarization → fallback summary
  → tool-pair integrity protection → drain/insert
- New agent_loop::context_window_for_model — auto-detect context window by model
- New agent_loop::is_context_length_error — detect upstream context-length errors
- New agent_loop::compact_tool_result_for_context — JSON/text sampling for large results
- Modified agent_loop::run_agent_loop — pre-turn compaction check, retry on context error
- Modified agent_events::AgentEnd — split total_tokens into input_tokens/output_tokens
- New agent_events::ContextCompacted — compaction event with metrics
- New AiConfig.context_window — user-configurable context window size
- New AiChatMessage.kind — context summary message marker
- Modified stream_with_tools & 3 provider stream functions — extract TokenUsage
  - Claude: message_start(input) + message_delta(output)
  - OpenAI: stream_options { include_usage } → final usage chunk
  - Gemini: usageMetadata per chunk, keep last

### Frontend (TypeScript/Vue)
- AiAssistant.vue: token + cost display row, estimateCost() with 7 model families,
  contextCompacted UI step, pendingCompaction deferred apply,
  messagesForAgentHistory post-compaction history reconstruction
- EditorSettingsDialog.vue: contextWindow input (min=1000, auto-detect)
- settingsStore.ts: AiConfig.contextWindow field
- tauri.ts: AgentEvent type updates, AiChatMessage.kind
- i18n: 6 new keys in en.ts and zh-CN.ts

## Fixed Issues
- messages[0] dropped from LLM context after compaction
- estimate_text_tokens hard threshold causing 2.8x estimate jump
- context_compacted event field semantics mismatch with frontend insert position
- validate_summary English-only keywords causing fallback on non-English LLMs
- Stale agentTokens after conversation switch
@

* remove cost computation logic
 2026-06-15 18:55:22 +08:00
t8y2 46ddcaba56 fix: normalize channel_binding=require to prefer for postgres 2026-06-15 17:44:00 +08:00
t8y2 3ee2514d07 fix(databend): enable editing and procedures 2026-06-15 17:43:44 +08:00
t8y2 e0d481cc2e fix(postgres): handle tsvector columns 2026-06-15 16:59:01 +08:00
t8y2 f2a0c65724 fix(ssh): support legacy kex algorithms 2026-06-15 16:15:44 +08:00
t8y2 026a0d2b12 fix(data): preserve unsafe int64 display 2026-06-15 15:14:38 +08:00
t8y2 ab5bd1dd25 fix(redis): batch SCAN server-side to reduce fetch-all latency 2026-06-15 15:01:13 +08:00
t8y2 08fb5bbf4d fix(query): avoid retrying local query timeouts 2026-06-15 14:42:03 +08:00
t8y2 8eb5f22069 fix(iris): clone table with valid false predicate 2026-06-15 14:23:40 +08:00
t8y2 a32ead56b9 fix(query): skip comment-only SQL execution 2026-06-15 14:18:40 +08:00
t8y2 7bb869d398 fix(mongodb): support legacy driver fallback 2026-06-15 14:07:31 +08:00
Abeautifulsnow d845a318c6 feat(ai-agent): Phase 3 — explain_query tool, parallel/sequential execution, DB gating (#1187) 
- Add explain_query tool with structured EXPLAIN result, gated on supports_explain_plan()
- Add supports_sql_query() to gate execute_query/get_sample_data for non-SQL DBs (Redis, ES, MongoDB, etc.)
- Split agent loop tool dispatch: execute_query runs sequentially, all others run in parallel via join_all
- Wire explain_query result button to ExplainPlanViewer in AiAssistant + App.vue
- Fix O(n²) agentSteps rebuild: incremental O(1) push per event during streaming
- finally block falls back to full rebuild only when streaming push did not occur
 2026-06-15 13:14:59 +08:00
t8y2 aab30d7c44 fix(mysql): prefer text protocol for result sets 2026-06-15 12:07:58 +08:00
John Jin 6f480ca047 fix(influxdb): fix incompatible result sets with older versions 
Thanks for the fix!
 2026-06-15 11:50:15 +08:00
t8y2 941958a512 fix: skip non-JSON stdout lines during agent startup 2026-06-15 11:41:39 +08:00
t8y2 ef426a8218 feat(redis): add Pub/Sub publish and subscribe with WebSocket real-time push 2026-06-15 01:40:06 +08:00
John Jin 1afc271c18 feat: add QuestDB support 
Thanks @ptma!
 2026-06-14 22:58:05 +08:00
t8y2 7b2156446c fix(mongodb): use tls param for form connections 2026-06-14 16:06:37 +08:00
Vergil Lai f385386284 feat(manticore): add Manticore Search support 
Add Manticore Search table data editing, structure editing, metadata handling, and SQL completion support.
 2026-06-14 16:01:02 +08:00
t8y2 ea85e22ea0 fix: update gbase default agent key test to gbase8a 2026-06-14 12:22:08 +08:00
t8y2 babdd7f12f fix(oracle): reuse connection runtime for schemas 2026-06-14 11:40:48 +08:00
t8y2 cbc7f9b0db fix(gbase): support 8a and 8s profiles 2026-06-14 10:16:24 +08:00
t8y2 7c5021fa91 feat(turso): simplify connection form to URL + token 2026-06-13 20:33:32 +08:00
Vergil Lai 799d20a2cf 添加 Manticore Search 支持 (#1145) 
* 添加 Manticore Search 支持

* 更新 Manticore Search 文档
 2026-06-13 20:23:36 +08:00
LC 2d98b9fdd2 feat(sqlite): add database backup action 
* feat(sqlite): add database backup action

* fix(sqlite): sanitize default backup file name
 2026-06-13 18:39:12 +08:00
t8y2 0b9aef1ca8 feat(settings): split driver store paths 2026-06-13 17:27:58 +08:00
t8y2 74546fee5c fix(storage): persist driver store setting 2026-06-13 17:13:59 +08:00
John Jin b640cbd0ba fix: influxdb code removed on merge 
Thanks for the fix!
 2026-06-13 17:03:27 +08:00
t8y2 d974ad5533 feat(settings): add custom driver store path with migration 2026-06-13 16:54:04 +08:00
t8y2 d091b0db85 feat(sidebar): reveal local db file in OS file manager 2026-06-13 16:00:47 +08:00
t8y2 30afcb8e69 fix(sidebar): page large table groups 2026-06-13 13:40:36 +08:00
t8y2 2d1d40f6ab feat(highgo): geometry/geography map preview via agent column_types 2026-06-13 10:25:12 +08:00
t8y2 ef5b6eb654 fix(transfer): preserve MySQL AUTO_INCREMENT and column defaults in cross-instance copy 2026-06-13 08:24:47 +08:00
t8y2 6e57197072 fix(sqlite): recognize INTEGER PRIMARY KEY as autoincrement in data grid save 2026-06-13 02:30:30 +08:00
t8y2 0767062bdb fix(agent): retry and rename fallback when removing old JRE on Windows 2026-06-13 01:56:29 +08:00
t8y2 c6e50f80f2 fix(ai): accept thinking/reasoning deltas as first stream chunk in connection test 2026-06-12 20:40:40 +08:00
skyler abacac3c07 feat(ai): agent loop Phase 2 — SQL execution tools, risk classification, and streaming tool calls 
feat(ai): agent loop Phase 2 — SQL execution tools, risk classification, and streaming tool calls
 2026-06-12 19:56:36 +08:00
t8y2 484658c6b7 feat(ai): streaming probe for connection test with latency measurement 2026-06-12 19:29:55 +08:00
runstone 40f0f98540 Merge branch 'main' of https://github.com/Abeautifulsnow/dbx into feat/ai-agent-loop-phase1 2026-06-12 18:52:05 +08:00
runstone 100124da3e feat(ai): Phase 2 SQL 风险分类 + Agent 模式工具调用结果渲染 
后端：
  - 新增 sql_risk.rs：基于 sqlparser AST 的 SQL 风险分类（ReadOnly/Write/Ddl/Transaction）
  - agent_tools.rs：新增 execute_query 和 get_sample_data 工具，写操作/DDL 被风险分类阻止
  - agent_loop.rs：支持 is_agent_mode 参数，Agent 模式下暴露全部工具，Ask 模式仅暴露只读工具
  - agent_loop/web/tauri：mode 参数全链路传递（前端→HTTP→Tauri→Rust）

  前端：
  - AiAgentStepItem 接口扩展：toolName/toolArgs/toolResult/isError 字段
  - AiAssistant.vue：工具调用结果实时+最终渲染，SQL 查询结果/错误信息展示
  - ai.ts/http.ts/tauri.ts：mode 参数透传到后端
 2026-06-12 17:42:23 +08:00
t8y2 115b539758 fix(core): gate duckdb schema metadata 2026-06-12 17:35:56 +08:00
t8y2 0fdff98200 fix(elasticsearch): route rest queries before sql parsing 2026-06-12 17:15:25 +08:00
polempandSam ef5ed05ae7 feat(schema-diff): professional DDL diff view with deployment-aware colors and custom themes (#1112) 
Co-authored-by: Sam <14344444@@qq.com>
 2026-06-12 17:14:05 +08:00
t8y2 2554ed95be fix(postgres): clear statement cache after ddl 2026-06-12 17:11:37 +08:00
t8y2 250da6e7cb fix(mysql): generate index COMMENT clause and enable index_comment capability 2026-06-12 16:56:20 +08:00
t8y2 edf9dd88e3 feat(agent): unify oracle driver 2026-06-12 16:34:42 +08:00
t8y2 415d53e8dc fix(duckdb): interrupt timed out queries 2026-06-12 16:27:33 +08:00
t8y2 2395727b6b fix(ai): auto-add /v1 prefix for bare-origin OpenAI-compatible endpoints 2026-06-12 16:10:42 +08:00
t8y2 e6db09c638 feat(agent): support language-neutral driver launch 2026-06-12 15:08:31 +08:00