Add to FAQ: Do I need whylogs in order to use langkit? about langkit HOT 2 OPEN

Good suggestion on adding this question to our FAQ!

Perhaps the important distinction to make here is that you don't need to use WhyLabs when using LangKit + whylogs.

LangKit defines UDFs which extract features from text (focused on language model scenarios). The LangKit UDFs are whylogs UDFs, and they execute as part of whylogs log() call, but whylogs can be used as an open source standalone tool, on premise.

whylogs executes UDFs to augment raw features and create additional extracted features useful for monitoring or data quality validation scenarios. The output of a whylogs log call contains a profile of this combined set of features to produce a compact statistical representation of your data. You can send these profiles to WhyLabs for storage and monitoring, but you don't have to use WhyLabs, check out these examples showing how to write/read profiles to disk or other locations: https://github.com/whylabs/whylogs/blob/mainline/python/examples/basic/Getting_Started.ipynb https://github.com/whylabs/whylogs/blob/mainline/python/examples/integrations/writers/Writing_Profiles.ipynb

The profiles themselves are good at giving you a compact statistical view of your data that can support a number of scenarios: profiles can compared and used to calculate drift, they can be validated against conditions, or used for visualization without retaining the raw data.

• https://github.com/whylabs/whylogs/blob/mainline/python/examples/advanced/Drift_Algorithm_Configuration.ipynb
• https://github.com/whylabs/whylogs/blob/mainline/python/examples/advanced/Metric_Constraints.ipynb
• https://github.com/whylabs/whylogs/blob/mainline/python/examples/basic/Notebook_Profile_Visualizer.ipynb

from langkit.

Thanks A LOT! :)

from langkit.