Sentry not logging errors

On-Premise
#1

Hi, I have an on-prem sentry installed from the install.sh script on docker I generating an error Im seeing the error generated that it is hitting the Nginx but sentry not picking it up Im sure that Im reaching Nginx cause I saw it from Nginx logs the log is the below. I went through every container log but did not found errors regarding this. Can someone piont me what is wrong please why its not logging the fail test in the sentry

{“log”:"2021/01/21 07:35:28 [warn] 7#7: *42566 a client request body is buffered to a temporary file /var/cache/nginx/client_temp/0000000118, client: x.x.x.x, server: , request: “POST /api/2/store/?sentry_key=4e16672138b84998b5fe0532cb5ec90a\u0026sentry_version=7 HTTP/1.1”, host: “sports-trader-sentry.igamingcloud.com”, referrer: “https://xx-xx.xx.xx.xx/"\n",“stream”:“stderr”,“time”:"2021-01-21T07:35:28.332592024Z”}
{“log”:“x.x.x.x - - [21/Jan/2021:07:35:28 +0000] “POST /api/2/store/?sentry_key=4e16672138b84998b5fe0532cb5ec90a\u0026sentry_version=7 HTTP/1.1” 200 41 “https://xx-xx.xx.xxx.xx/” “Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.141 Mobile Safari/537.36” “x.x.x.x”\n”,“stream”:“stdout”,“time”:“2021-01-21T07:35:28.33359245Z”}

#2

Do you see an entry in relay and in worker log?

1 Like
#3

This is what is being logged in worker
{“log”:“08:23:07 [INFO] sentry.tasks.update_user_reports: update_user_reports.records_updated (reports_to_update=0 reports_with_event=0 updated_reports=0)\n”,“stream”:“stdout”,“time”:“2021-01-21T08:23:07.774566504Z”}
{“log”:“08:23:07 [WARNING] sentry.tasks.release_registry: Release registry URL is not specified, skipping the task.\n”,“stream”:“stdout”,“time”:“2021-01-21T08:23:07.803485628Z”}

this is what is being logged in relay

{“log”:" caused by: no error details\n",“stream”:“stderr”,“time”:“2021-01-21T08:28:25.663227919Z”}
{“log”:“2021-01-21T08:28:37Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 60s\n”,“stream”:“stderr”,“time”:“2021-01-21T08:28:37.715110203Z”}
{“log”:“2021-01-21T08:28:55Z [relay_server::actors::events] ERROR: error processing event: event exceeded its configured lifetime\n”,“stream”:“stderr”,“time”:“2021-01-21T08:28:55.974561097Z”}
{“log”:“2021-01-21T08:28:56Z [relay_server::actors::events] ERROR: error processing event: event exceeded its configured lifetime\n”,“stream”:“stderr”,“time”:“2021-01-21T08:28:56.219143419Z”}

Don`t know if the logs are related

#4

Here is your error. Relay cannot process event. I would advise to set loglevel to debug in Relay to gather more info (Configuration Options | Sentry Documentation)

1 Like
#5

After I changed it to debug I`m getting this in the logs of the relay

“log”:“2021-01-21T08:54:43Z [relay_server::actors::project] DEBUG: project 4e16672138b84998b5fe0532cb5ec90a state request amended\n”,“stream”:“stderr”,“time”:“2021-01-21T08:54:43.951063895Z”}
{“log”:“2021-01-21T08:54:43Z [relay_server::actors::project] DEBUG: project 4e16672138b84998b5fe0532cb5ec90a state request amended\n”,“stream”:“stderr”,“time”:“2021-01-21T08:54:43.951225306Z”}
{“log”:“2021-01-21T08:54:46Z [relay_server::actors::project] DEBUG: project 4e16672138b84998b5fe0532cb5ec90a state request amended\n”,“stream”:“stderr”,“time”:“2021-01-21T08:54:46.395346075Z”}

#6

Does this value in the relay config has to be the URL of the sentry?
relay:
upstream: “http://web:9000”

#7

I have following in my config, maybe it helps:

  relay:
  upstream: "http://web:9000/"
  host: 0.0.0.0
  port: 3000
logging:
 level: DEBUG
processing:
  enabled: true
  kafka_config:
    - {name: "bootstrap.servers", value: "kafka:9092"}
    - {name: "message.max.bytes", value: 50000000} #50MB or bust
  redis: redis://redis:6379
  geoip_path: "/geoip/GeoLite2-City.mmdb"
#8

My relay settings are like these too

relay:
upstream: “http://web:9000/”
host: 0.0.0.0
port: 3000
logging:
level: DEBUG
processing:
enabled: true
kafka_config:
- {name: “bootstrap.servers”, value: “kafka:9092”}
- {name: “message.max.bytes”, value: 50000000} #50MB or bust
redis: redis://redis:6379
geoip_path: “/geoip/GeoLite2-City.mmdb”

I`m getting this error

{“log”:“2021-01-22T05:54:30Z [relay_server::actors::upstream] ERROR: authentication encountered error: upstream request returned error 503 Service Unavailable\n”,“stream”:“stderr”,“time”:“2021-01-22T05:54:30.828903722Z”}

#9

{“log”:“2021-01-22T06:49:09Z [relay_server::actors::project] DEBUG: project 872da088fb6f4fe5a8d340d6393e70e7 state request amended\n”,“stream”:“stderr”,“time”:“2021-01-22T06:49:09.330090254Z”}

still getting this in the logs and sentry still not logging