Proxy Setup Guide + Custom Prompts (For Openrouter & JanitorLLM)

Proxy Setup Guide + Custom Prompts (For Openrouter & JanitorLLM)

362

682

People will tell you to "Use a Proxy for free," but they will never tell you exactly how. So, I made this guide for all of you! Since I'm not a gatekeeper, I like to share the little knowledge I have, even though I'm a bit confused by it myself. I tried to make it easy to understand for all of you.

PS: I will be slow to update this guide from time to time, and the


Use a Proxy for a better experience with a bot, especially if it has a high amount of tokens, which causes the bot to lose memory quickly. Some Proxy Models work better than others, though. Just follow this & paste it in your "Proxy API Configurations" Section:

~

Guide:

Configuration Name: (Put in a nickname or something of your choice, or just put the name of the Proxy model you're using)

Model: nvidia/nemotron-3-super-120b-a12b:free

Proxy URL: https://openrouter.ai/api/v1/chat/completions

API Key: (Follow the steps below)

Step 1: Go here (Make sure to create an account first, or u won't be able to make a key):

Gemma 4 31B (free)

Step 2: Scroll down & click on "Create API Key". It will pull up your "Api keys", so then click on "Create" again at the top right corner (If you lose your key, you can simply create another the same way)

Step 3: Name your Api key (Don't touch anything else), then click on "Create", & then click on the little clipboard next to your Api key to copy your key, and paste it into your Api Key section in your "Proxy API Configurations." Remember to save it & refresh your page.


And that's it. Make sure to click "test" to see if your Proxy works. Also, two other things to mention:

1#: If you're looking to find other Free Proxy models (in case the one I have above doesn't work), go to the OpenRouter website I mentioned before & type in "Free" in the search bar, it will show you a list of other Free Models you can test out & use. Some Models may not work due to overload: (Proxy error 429, meaning that too many people are using the Model & the server temporarily shut down), so you just have to wait until they do work & find another model to use.

2#: There are other OpenRouter Guides on this website, so this guide might be kinda repetitive:

JanitorAI Guides / Openrouter API | Tutorial / HOW TO USE PROXY? (OPENROUTER GUIDE)

There are also these (Which explains what Proxy's are & how to use them):

The Absolute Beginner's Guide to Using a Proxy with Janitor Part One

The Absolute Beginner's Guide to Using a Proxy with Janitor Part Two

~

(CUSTOM PROMPT)

For your "Custom Prompt" (If you're using Proxy), try either of these & paste the prompt in your custom prompt:

My prompt | Saturnine's Deepseek Masterlist

Profile of @AurelieCatena

~

(GENERATION SETTING)

For "Generation Settings" (This is what I use for my settings; if you want other Generational Settings, check out "Pupi's Prompt Garden" or "Ი𐑼 brbiᦸkis' l𑄝rebary stuff" For Proxy & "Kolach3's Prompts" for JanitorLLM):

Temperature: 1

Max tokens: 0 ( Always keep this at 0; this is so the bot can fully generate a response & not stop halfway.)

Context Size: 16,000

~

(ADVANCED SETTINGS)

Advanced Settings (Idk a lot about this, so I wouldn't touch it, though I found this if you're using JanitorLLM):

Managed to get JLLM to work LEAGUES better than it usually does

Top K: 25

Top P: 0.25

Repetition Penalty: 1

Frequency Penalty: 0.5

(You can try this out below if you're using a Proxy, to see how it works or does something):

Top K: 70

Top P: 0.75

Repetition Penalty: 1.15

Frequency Penalty: 0.5

If the bot is speaking for you, it's an LLM issue. Try importing this in the chat memory (Credit to @ZieadamSz for this, check him out):

[{{char}} will not speak for {{user}}. {{char}} will not reuse dialogue. {{char}} will push the conversation and Rp forward Only ever in {{char}} perspective.]

If you're experiencing a Proxy Error & you're wondering what it means, visit this website: janitorai. Then, click on the JanitorAi logo that appears at the bottom right. This is a bot that will ask if you need any assistance with anything and will try to help you. Put the Proxy Error that you're having in the Chat [Example: What does "PROXY ERROR: No response from bot (pgshag2)" Mean?] and it will explain what the error means & solutions for it. (Sometimes it doesn't work for some reason)

~

Or you can just go here to find out what your Proxy error means: OpenRouter Error Guide

Hope this helps everyone. Massive props to the people who went out of their way to make custom prompts for others above.

proxy allowed

Published chats

0

comments

Leave a comment or feedback for the creator ❤️