Issues

• response_hallucination: convert_score() scores any off-vocabulary judge reply (including "Major Inaccurate." with a trailing period) as "accurate" (0.0)

  whylabs/langkit#329 · Filter by author shaurya416 opened on Sep 25, 2026

• Optional EvalPort adapter for langkit's per-metric result objects

  whylabs/langkit#328 · Filter by author adhabnr-ux opened on Sep 22, 2026

• Dependency Update for Sentence Transformers.

  whylabs/langkit#324 · Filter by author rishav-dey opened on Jun 6, 2025

• ValueError: Injections - unable to download embeddings

  whylabs/langkit#323 · Filter by author michelonfrancoisSUMMIT opened on Apr 1, 2025
  4

• PermissionError: [Errno 13] Permission denied: '/opt/app-root/lib/python3.9/site-packages/langkit/langkit_data'

  whylabs/langkit#322 · Filter by author pradeepdev-1995 opened on Feb 26, 2025

• Extracting RAI Metrics from Langkit

  whylabs/langkit#321 · Filter by author ishachinniah-hds opened on Feb 11, 2025

• How to use custom embedding model for checking prompt injection and prompt jailbreak similarity

  whylabs/langkit#320 · Filter by author pradeepdev-1995 opened on Dec 24, 2024
  1

• Toxicity Model Configuration notebook is failing

  whylabs/langkit#315 · Filter by author richard-rogers opened on Sep 30, 2024

• The model text-davinci-003 has been deprecated

  whylabs/langkit#314 · Filter by author richard-rogers opened on Sep 30, 2024

• Import error, architecture not supported for arm64

  whylabs/langkit#310 · Filter by author ghost opened on Jul 24, 2024

• SWE-Agent: Implement the hallucinations metric from the main branch in the workflow branch

  whylabs/langkit#298 · Filter by author naddeoa opened on Apr 21, 2024

• reduce latency in lazy initialization

  whylabs/langkit#278 · Filter by author FelipeAdachi opened on Mar 26, 2024

• add support for detoxify local models

  whylabs/langkit#277 · Filter by author FelipeAdachi opened on Mar 26, 2024

• Use custom prompt in response_hallucination

  whylabs/langkit#263 · Filter by author pradeepdev-1995 opened on Mar 11, 2024
  3

  

• Specify Python version compatibility

  whylabs/langkit#261 · Filter by author BVasquez07 opened on Mar 10, 2024
  3

  

• Need env variable to avoid attempted download of nltk artifacts

  whylabs/langkit#231 · Filter by author jamie256 opened on Feb 12, 2024

• Importing metrics issue since there is not a way to pass the model path if stored locally

  whylabs/langkit#230 · Filter by author Starignus opened on Feb 7, 2024
  3

  

• Need example of prompt column name override

  whylabs/langkit#226 · Filter by author jamie256 opened on Feb 1, 2024

• Add feature to use bedrock agent to do the evaluation

  whylabs/langkit#220 · Filter by author rajib76 opened on Jan 23, 2024

• text-davinci-003 OpenAI model deprecated

  whylabs/langkit#215 · Filter by author FelipeAdachi opened on Jan 10, 2024

• Response Hallucination: decouple LLMs for sample generation and consistency checking

  whylabs/langkit#205 · Filter by author FelipeAdachi opened on Nov 28, 2023

• response_hallucination: remove llm requirement for consistency check

  whylabs/langkit#204 · Filter by author FelipeAdachi opened on Nov 28, 2023

• Add support for AzureOpenAI

  whylabs/langkit#197 · Filter by author rajib76 opened on Nov 21, 2023
  9

• Add support for armv6l, armv7l chipset architecture

  enhancement
  whylabs/langkit#196 · Filter by author jamie256 opened on Nov 21, 2023

• Add support for python 3.12

  enhancement
  whylabs/langkit#195 · Filter by author jamie256 opened on Nov 21, 2023
  1