Performance turning for ingest-consumer

On-Premise
1

I’m running Sentry 21.6.1 on GKE and I’m having trouble with the ingest-transactions topic.

Datadog metrics are followings.

Consume Lag (all topics)

image
image2134×1114 228 KB

Other Consumer Lags are digested well, but only ingest-transactions are not reduced.

I think it is necessary to change the setting of ingest-consumer, but I am wondering how to change it.

Please let me know if you have a good idea.

My settings

I’m using GitHub - sentry-kubernetes/charts: Easily deploy Sentry on your Kubernetes Cluster

ingest-consumer

sentry:
  ingestConsumer:
    replicas: 1
    maxBatchSize: "1000"
    concurrency: "200"

    resources:
      limits:
        cpu: 2500m
        memory: 8Gi
      requests:
        cpu: 2500m
        memory: 6Gi

    tolerations:
      - key: cloud.google.com/gke-preemptible
        operator: Equal
        value: "true"
        effect: NoSchedule

    volumeMounts:
      - mountPath: /dev/shm
        name: dshm
    volumes:
      - name: dshm
        emptyDir:
          medium: Memory

partitions (snuba config)

config:
  snubaSettingsPy: |
    TOPIC_PARTITION_COUNTS = {
      "errors-replacements": 1,
      "event-replacements": 1,
      "events": 1,
      "ingest-attachments": 1,
      "ingest-events": 1,
      "ingest-sessions": 1,
      "ingest-transactions": 1,
      "outcomes": 1,
      "snuba-commit-log": 1,
    }

Please let me know if you need other settings.

Thank you.

2

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.