Model API

SDXL ControlNet Union

An efficent SDXL multi-controlnet image-to-image model.

Model id

Use this in every request

sdxl-controlnet-union/image-to-image

This model has other modes with their own ids: sdxl-controlnet-union, sdxl-controlnet-union/inpainting.

Run it

Quote the input, start the generation with the quote, then poll the job. Set RAYWAKE_API_KEY first; see Authentication.

# 1. Price the exact input (quotes are valid for up to 10 minutes)
curl -s https://api.raywake.com/v1/quotes \
  -H "Authorization: Bearer $RAYWAKE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "sdxl-controlnet-union/image-to-image",
  "input": {
    "prompt": "A red ceramic cup on a wooden table, soft morning light",
    "image_url": "https://example.com/input.png"
  }
}'

# 2. Start the generation with the quote_id from step 1
curl -s https://api.raywake.com/v1/generate \
  -H "Authorization: Bearer $RAYWAKE_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{"model": "sdxl-controlnet-union/image-to-image", "quote_id": "QUOTE_ID", "input": {"prompt":"A red ceramic cup on a wooden table, soft morning light","image_url":"https://example.com/input.png"}}'

# 3. Poll until the status is terminal
curl -s https://api.raywake.com/v1/jobs/JOB_ID \
  -H "Authorization: Bearer $RAYWAKE_API_KEY"

Input

Input fields for sdxl-controlnet-union/image-to-image
Name	Type	Description
`prompt`required	string	The prompt to use for generating the image. Be as descriptive as possible for best results.
`controlnet_conditioning_scale`	number	The scale of the controlnet conditioning. Default: `0.5`
`image_url`required	string (image URL)	The URL of the image to use as a starting point for the generation.
`negative_prompt`	string	The negative prompt to use.Use it to address details that you don't want in the image. This could be colors, objects, scenery and even the small details (e.g. moustache, blurry, low resolution).
`image_size`	string (enum)	The size of the generated image. Leave it none to automatically infer from the control image. One of: `square_hd`, `square`, `portrait_4_3`, `portrait_16_9`, `landscape_4_3`, `landscape_16_9`
`num_inference_steps`	integer	The number of inference steps to perform. Default: `35`
`guidance_scale`	number	The CFG (Classifier Free Guidance) scale is a measure of how close you want the model to stick to your prompt when looking for a related image to show you. Default: `7.5`
`strength`	number	determines how much the generated image resembles the initial image Default: `0.95`
`seed`	integer	The same seed and the same prompt given to the same version of Stable Diffusion will output the same image every time.
`sync_mode`	boolean	If `True`, the media will be returned as a data URI and the output data won't be available in the request history. Default: `false`
`num_images`	integer	The number of images to generate. Default: `1`
`loras`	array of objects	The list of LoRA weights to use.
`embeddings`	array of objects	The list of embeddings to use.
`enable_prompt_expansion`	boolean	If set to true, the prompt will be expanded with additional prompts. Default: `false`
`format`	string (enum)	The format of the generated image. Default: `jpeg` One of: `jpeg`, `png`
`preserve_aspect_ratio`	boolean	If set to true, the aspect ratio of the generated image will be preserved even if the image size is too large. However, if the image is not a multiple of 32 in width or height, it will be resized to the nearest multiple of 32. By default, this snapping to the nearest multiple of 32 will not preserve the aspect ratio. Set crop_output to True, to crop the output to the proper aspect ratio after generating. Default: `false`
`crop_output`	boolean	If set to true, the output cropped to the proper aspect ratio after generating. Default: `false`
`openpose_image_url`	string (image URL)	The URL of the control image.
`openpose_preprocess`	boolean	Whether to preprocess the openpose image. Default: `true`
`depth_image_url`	string (image URL)	The URL of the control image.
`depth_preprocess`	boolean	Whether to preprocess the depth image. Default: `true`
`teed_image_url`	string (image URL)	The URL of the control image.
`teed_preprocess`	boolean	Whether to preprocess the teed image. Default: `true`
`canny_image_url`	string (image URL)	The URL of the control image.
`canny_preprocess`	boolean	Whether to preprocess the canny image. Default: `true`
`normal_image_url`	string (image URL)	The URL of the control image.
`normal_preprocess`	boolean	Whether to preprocess the normal image. Default: `true`
`segmentation_image_url`	string (image URL)	The URL of the control image.
`segmentation_preprocess`	boolean	Whether to preprocess the segmentation image. Default: `true`

Output

A succeeded job lists its results under outputs, stored on our side. See Jobs for every field.

Job excerpt

"outputs": [
  { "type": "image", "url": "https://…", "mime_type": "image/png", "thumbnail_url": "https://…" }
]

Pricing

up to$0.60/ run

The exact charge for your input comes from a quote. How charges settle