https://coursiv.io/blog/tags/building--running-aiRecent content in Building & Running AI on Coursiv BlogHugo -- 0.147.0en-UShttps://coursiv.io/blog/glossary/apiMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/apiThe interface your code uses to send a prompt to a model and get a response back.https://coursiv.io/blog/glossary/api-keyMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/api-keyThe secret credential that authenticates and bills your API calls — and must never reach a browser.https://coursiv.io/blog/glossary/batch-inferenceMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/batch-inferenceRunning many predictions together as a job instead of one at a time in real time.https://coursiv.io/blog/glossary/chunkingMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/chunkingSplitting documents into passages small enough to embed and retrieve usefully.https://coursiv.io/blog/glossary/gpuMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/gpuThe parallel processor that made deep learning practical, and the scarcest resource in the industry.https://coursiv.io/blog/glossary/hybrid-searchMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/hybrid-searchCombining keyword and vector search, because each fails where the other works.https://coursiv.io/blog/glossary/inference-costMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/inference-costWhat it costs to run a model in production, billed per token in and per token out.https://coursiv.io/blog/glossary/latencyMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/latencyHow long a request takes — the difference between an assistant that feels alive and one that feels broken.https://coursiv.io/blog/glossary/llmopsMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/llmopsMLOps for systems built on language models — prompts, evals, cost, and safety instead of training runs.https://coursiv.io/blog/glossary/mlopsMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/mlopsThe practices for getting machine learning models into production and keeping them working.https://coursiv.io/blog/glossary/on-device-aiMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/on-device-aiRunning a model on a phone or laptop instead of sending data to a server.https://coursiv.io/blog/glossary/prompt-cachingMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/prompt-cachingReusing the processed form of a repeated prompt prefix so you do not pay full price for it again.https://coursiv.io/blog/glossary/rate-limitMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/rate-limitThe cap a provider puts on how many requests or tokens you can use per interval.https://coursiv.io/blog/glossary/sdkMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/sdkAn official library that wraps a provider's API in your programming language.https://coursiv.io/blog/glossary/throughputMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/throughputHow much work a system handles per unit of time — tokens per second, requests per minute.https://coursiv.io/blog/glossary/tpuMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/tpuGoogle's custom accelerator chip, purpose-built for machine learning workloads.https://coursiv.io/blog/glossary/vector-searchMon, 01 Jan 0001 00:00:00 +0000https://coursiv.io/blog/glossary/vector-searchFinding content by meaning rather than by matching keywords.