Arkive/arkive
1
0
Fork 0
Code Issues 18 Pull requests 1 Projects Releases Packages Wiki Activity Actions

[Duplicate] Federate search and citations across core and local stores #41

New issue
Closed
opened 2026-07-31 01:21:15 -04:00 by JackFrostbyte · 1 comment
JackFrostbyte commented 2026-07-31 01:21:15 -04:00
Owner
Copy link

Goal

Allow one local Arkive query to search the redistributable core and the optional
user-local overlay while preserving provenance and legal/distribution boundaries.

Requirements

  • Query each index independently and merge results at the application layer.
  • Every result visibly identifies bundled_core or user_local.
  • Citations resolve to the correct store and exact passage.
  • Local citations include local acquisition provenance and recipe/version where
    appropriate, without exposing credentials or sensitive account data.
  • Missing or disconnected local storage degrades cleanly to core-only search.
  • Ranking must not hide the distribution domain.
  • Export/copy actions warn when selected material includes local-only content.
  • Diagnostic output never uploads or embeds local source text by default.

Deliverables

  • Federated query interface.
  • Domain-aware result and citation models.
  • CLI presentation and filters (core, local, all).
  • Mixed-domain fixtures and tests.
  • Documentation for offline and portable deployments.

Acceptance criteria

  • A result's domain is unambiguous from search through citation resolution.
  • Core-only operation remains unchanged when no local overlay exists.
  • Local-only citations never resolve against bundled files.
  • Search refuses stale/corrupt local indexes according to existing validation rules.
  • Export warnings are covered by tests.

Out of scope

  • LLM/RAG answer generation.
  • Redistributing the user's local overlay.
## Goal Allow one local Arkive query to search the redistributable core and the optional user-local overlay while preserving provenance and legal/distribution boundaries. ## Requirements - Query each index independently and merge results at the application layer. - Every result visibly identifies `bundled_core` or `user_local`. - Citations resolve to the correct store and exact passage. - Local citations include local acquisition provenance and recipe/version where appropriate, without exposing credentials or sensitive account data. - Missing or disconnected local storage degrades cleanly to core-only search. - Ranking must not hide the distribution domain. - Export/copy actions warn when selected material includes local-only content. - Diagnostic output never uploads or embeds local source text by default. ## Deliverables - Federated query interface. - Domain-aware result and citation models. - CLI presentation and filters (`core`, `local`, `all`). - Mixed-domain fixtures and tests. - Documentation for offline and portable deployments. ## Acceptance criteria - [ ] A result's domain is unambiguous from search through citation resolution. - [ ] Core-only operation remains unchanged when no local overlay exists. - [ ] Local-only citations never resolve against bundled files. - [ ] Search refuses stale/corrupt local indexes according to existing validation rules. - [ ] Export warnings are covered by tests. ## Out of scope - LLM/RAG answer generation. - Redistributing the user's local overlay.
JackFrostbyte commented 2026-07-31 01:35:55 -04:00
Author
Owner
Copy link

Closing this issue as a duplicate of #49.

Issues #41 and #49 were created with the same roadmap
content during recovery from an interrupted automation run. The later set
#43–#50 is canonical because Issue #34's finalized roadmap body, roadmap comment,
and dependency graph reference that set.

No implementation work was completed in this duplicate issue.

<!-- arkive-roadmap-duplicate-cleanup-v1 --> Closing this issue as a duplicate of #49. Issues #41 and #49 were created with the same roadmap content during recovery from an interrupted automation run. The later set #43–#50 is canonical because Issue #34's finalized roadmap body, roadmap comment, and dependency graph reference that set. No implementation work was completed in this duplicate issue.
JackFrostbyte changed title from Federate search and citations across core and local stores to [Duplicate] Federate search and citations across core and local stores 2026-07-31 01:35:55 -04:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
feature/issue-17-reproducibility-tests
develop
No results found.
Labels
Clear labels
  
area/deployment
Portable packaging and constrained-environment validation

  
area/governance
Project rules, policies, contributor workflow

  
area/metadata
Schemas, manifests, validation contracts

  
area/pipeline
Import, extraction, normalization, chunking

  
area/search
Indexing, retrieval, citation resolution

  
type/data
Source selection, metadata, fixtures, and corpus work

  
type/design
Architecture, policy, contracts, and ADR work

  
type/implementation
Production code or tooling

  
type/testing
Reproducibility, integration, evaluation, and benchmark work

No labels
area/deployment
area/governance
area/metadata
area/pipeline
area/search
type/data
type/design
type/implementation
type/testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Arkive/arkive#41
No description provided.