@metreeca/llms
    Preparing search index...

    @metreeca/llms

    Ready-made tasks and shared services for AI jobs.

    @metreeca/llms provides ready-made @metreeca/flow tasks for putting language models to work in a pipeline: prompting a model, extracting structured records from free text, and embedding content for semantic retrieval. The tasks run under the @metreeca/gear job executor, which supplies the shared services they draw on, including the clients of the model providers they reach.

    • Ready-Made Tasks: prompting, extraction and embedding, chaining alongside any other task
    • Shared Services: model clients, credentials and response caches, built on demand and released after the run
    • Custom Bindings: a stubbed, throttled or recorded model swapped in for a run, leaving the job untouched
    • Minimal Footprint: one package per model provider, each pulling in only the SDK that provider needs
    Important

    Pipelines are server-side workloads targeting Node.js 22 or later, relying on facilities such as the filesystem, the process environment and fetch. The packages are not intended for the browser.

    Installation

    npm install @metreeca/gear             # job executor and shared services
    npm install @metreeca/llms # AI tasks and shared services
    npm install @metreeca/llms-<provider> # model connectors, one package per provider
    Warning

    TypeScript consumers must use "moduleResolution": "nodenext"/"node16"/"bundler" in tsconfig.json. The legacy "node" resolver is not supported.

    Install the core package, then add a connector package for each model provider the pipeline reaches. Each connector package pulls in only the SDK its own provider needs. The @metreeca/gear job executor ships separately: install it directly to set up and run the jobs putting tasks and connectors to work.

    Package Description
    @metreeca/llms AI tasks and shared services
    @metreeca/llms-google Google model connectors
    @metreeca/llms-openai OpenAI model connectors

    Usage

    Note

    Each package documents its own API in its README and API reference; for complete coverage, see the API reference.

    Support

    • open an issue to report a problem or to suggest a new feature
    • start a discussion to ask a how-to question or to share an idea

    License

    This project is licensed under the Apache 2.0 License – see LICENSE file for details.