Repository navigation
[ai-assisted] feat(rag): 외부 웹 수집과 근거 통합 추가 - #527
Merged
Merged
Conversation
Issue: - 별도 Issue 없음 (대화형 작업 요청으로 기능 범위와 완료 기준을 확정함) Why: - 공개 HTTPS 자료를 수집·색인하고 첨부 문서와 함께 검증 가능한 RAG 근거로 사용하기 위해 변경합니다. - 검색 실패, 근거 구성 실패, 인용 검증 실패를 구분하고 답변 정책과 SSE 완료 계약을 통일할 필요가 있습니다. What: - 단일 페이지와 제한된 사이트 수집을 지원하는 web-knowledge 모듈, 보안 수집기, 상태·quota·revision 저장 및 다중 DB migration을 추가했습니다. - INDEXED_WEB 근거 선택, 다중 출처 검색·packing, 답변 정책, citation 검증, cache·SSE·대화 계약을 연결했습니다. - attachment 권한, embedding/vector partition, provider 오류 처리와 관련 문서·회귀 테스트를 보완했습니다. Validation: - ./gradlew :starter:studio-platform-starter-ai-web:test :starter:studio-platform-starter-ai:test :starter:studio-platform-starter-markdown:test :starter:studio-platform-starter-security:test :studio-application-modules:web-knowledge-service:test :starter:studio-application-starter-web-knowledge:test :studio-application-modules:attachment-service:test :starter:studio-application-starter-attachment:test - Result: BUILD SUCCESSFUL - git diff --cached --check - Result: 통과 - staged path 및 알려진 비밀키 패턴 검사 - Result: 이상 없음
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
What
web-knowledge-service와 starter를 추가해 단일 페이지 및 제한된 사이트 수집, revision/CAS, quota, refresh/cancel, HTML 정규화와 RAG 색인을 구현했습니다.INDEXED_WEB근거 선택, 문서·웹 다중 출처 검색과 packing, source-comparison coverage, 답변 정책 및 인용 검증을 공통 RAG 완료 경로에 연결했습니다.complete, cache, conversation에 반영하고 실패 단계별 outcome과 exact excerpt 근거 후보를 제공합니다.Related Issues
Validation
./gradlew :starter:studio-platform-starter-ai-web:test :starter:studio-platform-starter-ai:test :starter:studio-platform-starter-markdown:test :starter:studio-platform-starter-security:test :studio-application-modules:web-knowledge-service:test :starter:studio-application-starter-web-knowledge:test :studio-application-modules:attachment-service:test :starter:studio-application-starter-attachment:testBUILD SUCCESSFULgit diff --cached --check.omx·비밀키 패턴 없음ANSWERED,INDEX_VALID,STRUCTURE_VALID,DOCUMENT + INDEXED_WEBpacking 및 웹 근거 reference 반환 확인Risk / Rollback
studio.ai.indexed-web.enabled=false로 URL 수집을 비활성화합니다. 신규 테이블은 기존 데이터와 분리되어 있으며 기존 attachment 색인에는 backfill을 수행하지 않습니다.AI / Subagent Usage
Checklist
AI-Assistedvalue is correct