The prompt-layer-js's discuss from magnivorg

expose a way for users to publish prompt templates in new schema

fix return_pl_id while streaming on javascript library

Steps to Reproduce

Make a streaming request to openai or anthropic
Make sure you pass in return_pl_id: true and stream: true

Expected Result
You get a tuple back with first index being the generator and second being the request_id from PromptLayer. request_id is populated on last iteration of for loop

Actual Result
You get an error

proxy and log anthropic requests

With this task, we should be able to proxy and log requests made via anthropic node package. Like openai, this should be transparent to the user and should not affect in any way they use anthropic package.

track metadata, score, prompt, and create group

We have exposed multiple functions in our python sdk

track metadata
track score
track prompt
create group

We need a replica of such functions in our javascript sdk.

fix native module not found in nextjs edge runtime

Steps to Reproduce

Create a new nextjs app following the instructions here
Install promptlayer using the instructions here

Expected Output
You are able to log requests on promptlayer using the code snippets from promptlayer documentation

Actual Output
You get Error [TypeError]: Native module not found error

For more details read here

fix do not return the accumulated streaming result to the user

Steps to Reproduce

Create a streaming request to OpenAI
console.log the response of each chunk

Expected Result
All the chunks are successfully logged without any error

Actual Result
Last chunk gives undefined error

For more details read here

Tracking not working

use the updated endpoint for publishing prompt templates

docs for js library first milestone

add function names from js library to api

add a function for fetching all the prompt templates

The purpose of this task is to add support for the new endpoint /prompt-templates for fetching prompt templates in standard shape. Read more about the endpoint here

add support for claude via javascript library

Simmilar to the support for the python library we should add support for the javascript library as well.

track requests from js library

With this task, the goal is to have an interface that allows the user to track requests using our rest endpoint.

Dependency issues/confusion

allow any shape of data in input variables

fix mapping for streaming chat responses

Cannot import library in SvelteKit/TypeScript

I started integrating PromptLayer and got this error.

Error when evaluating SSR module /Users/......+server.ts:

Internal server error: Failed to resolve entry for package "promptlayer". The package may have incorrect main/module/exports specified in its package.json.

This happens when I start importing PromptLayer using this

import { promptlayer } from "promptlayer";

This happens even if the file is just importing PromptLayer. Using SvelteKit + TypeScript

fix lazy loading issue in nextjs

Steps to Reproduce

Create a new nextjs app following the instructions here
Install promptlayer using the instructions here

Expected Output
You are able to log requests on promptlayer using the code snippets from promptlayer documentation

Actual Output
You get MODULE_NOT_FOUND error

For more details read here

create a wrapper for streaming responses and log the cumulative response in PL

With this task, our proxy around openai package should be able to support streaming responses and log the cumulative response on PL as well. Also, as part of this task, our proxy should be transparent to the end user.

add types for placeholder message

proxy openai requests from js library

This particular task will deal with proxying openai npm package and ensure that requests made through proxied object are logged on promptlayer. This change should enable the customer to only change the following line of code

import OpenAI from "openai";
import { OpenAI } from "promptlayer";

create a script for logging requests from google gemini

The purpose of this task is to create a script for logging requests made via google gemini. This task will include serialization of data to be sent over network.

get all prompt templates

We also want to expose a function which users can use to fetch all the prompt templates they have in our system. This will also behave similar to our python sdk.

expose a way to get prompt template

We already have exposed a method to get prompt template by name in our python sdk. We need a replica of the same functionality in our js library.

integrate metadata filter for templates get

Allow users to pass in metadata_filter for fetching prompt templates dynamically.

add type definitions for publishing prompt template

Improve error messaging

Error messaging are a bit confusing to understand.

publish prompt template

Just like our python sdk, we need to expose a way for users to publish prompt templates. There is going to be one key difference with this one i.e. we will not depend on langchain at all.

implement `templates.get` in js sdk

update the sdk to send streamed data in a standard form

Currently, whenever we log streamed requests, we are defining a new structure and send it to the server for logging purposes. It should send the data in standard completion or chat model whichever is applicable.

Streaming results from tool calls not working

  openai.chat.completions.create(openAIOptions).then(async (completion: any) => {
    for await (const part of completion) {
      if (Array.isArray(part)) {
        const [chunk, pl_id] = part;
        console.log('----')
        console.log(chunk);
        console.log('-')
        console.log(chunk.choices[0].delta)
        console.log(pl_id);
      } else {
        console.log(part);
        console.log(part.choices[0].delta.tool_calls[0].function)
      }
    }
  });

const cleaned_result = (results: any[]) => {
  if ("completion" in results[0])
    return results.reduce(
      (prev, current) => ({
        ...current,
        completion: `${prev.completion}${current.completion}`,
      }),
      {}
    );
  if ("text" in results[0].choices[0]) {
    let response = "";
    for (const result of results) {
      response = `${response}${result.choices[0].text}`;
    }
    const final_result = structuredClone(results.at(-1));
    final_result.choices[0].text = response;
    return final_result;
  } else if ("delta" in results[0].choices[0]) {
    let response = { role: "", content: "" };
    for (const result of results) {
      if ("role" in result.choices[0].delta) {
        response.role = result.choices[0].delta.role;
      }
      if ("content" in result.choices[0].delta) {
        response.content = `${response["content"]}${result.choices[0].delta.content}`;
      }
    }
    const final_result = structuredClone(results.at(-1));
    final_result.choices[0] = response;
    return final_result;
  }
  return "";
};

add streaming support for anthropic tool use

According to the docs requests with tool use don't support streaming at the moment. But, when anthropic tool use functionality goes GA, we should add support for it.

update minimum requirements

The purpose of this task is to update the minimum requirements to use latest LTS version of Node i.e. 18.x.

add promptlayer run that allows you to run LLM requests using prompt registry

Expose a new function called run that provided the following attributes

prompt_name
version
label
input_variables
tags
metadata
group_id
client (Optional)
does the following steps in order

calls templates.get with the relevant attributes
use the type information to decide which functions to call
track the request after response is received
return the response (id, response, raw_response)

magnivorg / prompt-layer-js Goto Github PK

prompt-layer-js's Issues

Steps to Reproduce

Steps to Reproduce

Steps to Reproduce

Steps to Reproduce

Recommend Projects

Recommend Topics

Recommend Org