Overall Service level indicators are traditionally classified on 3 dimensions - availability, performance and correctness. While they mean different things when used in context of Data product (and their meaning changes based on type of data product) , all 3 hold true. However, there is one more characteristic that deems important to serve as an indicator - specifically for data. That's security.
Details
The same holds true for a Data product:
- Availability
- Technically the uptime the user can expect.
- But also how accessible it is - support for different access patterns.
- Ability to mutate/fix and delete (forget like [Machine Learning](Machine Unlearning in 2024 - Ken Ziyu Liu - Stanford Computer Science))
- Performance
- How fast can we get the desired insight out of the data product, or fix an observed anomaly.
- Correctness
- What time window does the product capture, how old, how recent.
- How much of the data is present vs missing
- Security
- What are the level of access controls in place
Examples
Product | Availability | Performance | Correctness | Security |
---|---|---|---|---|
Google analytics | ||||
ChatGPT 3.5 | Limited | Low due to hallucinations | ||
GPT4 | ||||
Grammerly |
- Completeness (like freshness)
- Query-ability - SQL like, programmatic, drag drop, excel.
- Mutability (like forgetfulness )
- Bias-freeness