Skip to content

Instantly share code, notes, and snippets.

@mleklund
Last active February 4, 2020 17:49
Show Gist options
  • Save mleklund/20f89f04ef7e2e1e50a6971f282f41e6 to your computer and use it in GitHub Desktop.
Save mleklund/20f89f04ef7e2e1e50a6971f282f41e6 to your computer and use it in GitHub Desktop.
5:30PM INF authenticate: verify session, refresh error="authenticate: refresh save failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded" X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["authenticate.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] ip=10.245.239.237 req_id=4c0e6c17-c28e-b492-c518-7249fbb8a3f5 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM DBG http-request X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["authenticate.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] duration=10847.32015 email= group= host=authenticate.domain.com ip=10.245.239.237 method=GET path=/.pomerium/sign_in?pomerium_expiry=1580837706&pomerium_issued=1580837406&pomerium_redirect_uri=https%3A%2F%2Fhttpbin.domain.com%2F&pomerium_signature=T4lNcKSpX8INM-Hv5wwlZCgWRA_iBsJPNRg8saMTRv0%3D req_id=4c0e6c17-c28e-b492-c518-7249fbb8a3f5 service=authenticate size=848 status=302 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM INF httputil: ErrorResponse error="Internal Server Error: oauth callback : failed saving new session: rpc error: code = DeadlineExceeded desc = context deadline exceeded" X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["authenticate.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] ip=10.245.239.237 referer=https://accounts.google.com/signin/oauth/oauthchooseaccount?client_id=CLIENTID.apps.googleusercontent.com&as=EygV7-0oNF8NbtCiiEcBcA&destination=https%3A%2F%2Fauthenticate.domain.com&approval_state=!ChRhV2NjakhKa3Z0SnIxajN4RllEOBIfUTlibEtUamtVTmNjVUU3MWpGWk5XazB6RmdzVUFSYw%E2%88%99AJDr988AAAAAXjr7qU79hL7ZC_qFwJfP9B3BRLLQ3eBX&oauthgdpr=1&xsrfsig=ChkAeAh8T9dCCt2bhP2uOZclw29tsCbrsmfSEg5hcHByb3ZhbF9zdGF0ZRILZGVzdGluYXRpb24SBXNvYWN1Eg9vYXV0aHJpc2t5c2NvcGU&flowName=GeneralOAuthFlow req_id=988f1adb-1f71-8bc9-6483-914aa7675f9b user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM DBG http-request X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["authenticate.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] duration=10396.816626 email= group= host=authenticate.domain.com ip=10.245.239.237 method=GET path=/oauth2/callback?state=aVdGaWZPcEwxQ2ZwTG51V1Y5T0JmWmkyRnBPczA5NDNINlpNL1Q1VjN1VFdTZkFPS0daQ2dmb29WZ0ZaR1ZlZGZGYUE3TWsvS1VWZXBvMXFDM3Y5V3c9PXwxNTgwODM3NDE3fIU87t8oJME1PaPHNFIcPqA0sQjuihWXcctzpMmNHQGN9pH6HrwIRzYBcM3FeH6StTKLfBQOp5brLOdk9IzeZ2q3C_jHwDjCmlIt9Q7H5-Pw8b08_x-VWHziZTSDSyaUrrWddA6MPyGaOmvOFY0Y8hnoTfnmgfeZImXz_8MSPCZwJS3Iv_YPl_HAfVEzbJi2hA07cayuQTPzS-3HNgt1WpOvHu1RvdEx9RPlLN0rZdD0z_7bCnkgj2V5gbhShHR_OgnLCvH6LSjy6TNs5ubdfAWZlRLzJF0hqYEl8oqOGITODLBMS0Vz2Jw3mAdR6E3YjvSuTqOyGzO53Rk7tcHium4qOulgcYAWBeXySs76X94%3D&code=4/wAFlGpivg7qp0vAMB2co9WXKmvrvOHDvZ1X4QeyBQQVSGhkdd8TcXQh4ol-uIGKoA1uJDF6-zRxS0_oIHuaOdw4&scope=email%20profile%20openid%20https://www.googleapis.com/auth/userinfo.profile%20https://www.googleapis.com/auth/userinfo.email&authuser=0&hd=domain.com&prompt=consent&session_state=649633da41c6148080506e104abef8e1262c76d8..3c52 referer=https://accounts.google.com/signin/oauth/oauthchooseaccount?client_id=CLIENTID.apps.googleusercontent.com&as=EygV7-0oNF8NbtCiiEcBcA&destination=https%3A%2F%2Fauthenticate.domain.com&approval_state=!ChRhV2NjakhKa3Z0SnIxajN4RllEOBIfUTlibEtUamtVTmNjVUU3MWpGWk5XazB6RmdzVUFSYw%E2%88%99AJDr988AAAAAXjr7qU79hL7ZC_qFwJfP9B3BRLLQ3eBX&oauthgdpr=1&xsrfsig=ChkAeAh8T9dCCt2bhP2uOZclw29tsCbrsmfSEg5hcHByb3ZhbF9zdGF0ZRILZGVzdGluYXRpb24SBXNvYWN1Eg9vYXV0aHJpc2t5c2NvcGU&flowName=GeneralOAuthFlow req_id=988f1adb-1f71-8bc9-6483-914aa7675f9b service=authenticate size=1510 status=500 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM DBG http-request X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["authenticate.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] duration=0.042362 email= group= host=authenticate.domain.com ip=10.245.239.237 method=GET path=/favicon.ico referer=https://authenticate.domain.com/oauth2/callback?state=aVdGaWZPcEwxQ2ZwTG51V1Y5T0JmWmkyRnBPczA5NDNINlpNL1Q1VjN1VFdTZkFPS0daQ2dmb29WZ0ZaR1ZlZGZGYUE3TWsvS1VWZXBvMXFDM3Y5V3c9PXwxNTgwODM3NDE3fIU87t8oJME1PaPHNFIcPqA0sQjuihWXcctzpMmNHQGN9pH6HrwIRzYBcM3FeH6StTKLfBQOp5brLOdk9IzeZ2q3C_jHwDjCmlIt9Q7H5-Pw8b08_x-VWHziZTSDSyaUrrWddA6MPyGaOmvOFY0Y8hnoTfnmgfeZImXz_8MSPCZwJS3Iv_YPl_HAfVEzbJi2hA07cayuQTPzS-3HNgt1WpOvHu1RvdEx9RPlLN0rZdD0z_7bCnkgj2V5gbhShHR_OgnLCvH6LSjy6TNs5ubdfAWZlRLzJF0hqYEl8oqOGITODLBMS0Vz2Jw3mAdR6E3YjvSuTqOyGzO53Rk7tcHium4qOulgcYAWBeXySs76X94%3D&code=4/wAFlGpivg7qp0vAMB2co9WXKmvrvOHDvZ1X4QeyBQQVSGhkdd8TcXQh4ol-uIGKoA1uJDF6-zRxS0_oIHuaOdw4&scope=email%20profile%20openid%20https://www.googleapis.com/auth/userinfo.profile%20https://www.googleapis.com/auth/userinfo.email&authuser=0&hd=domain.com&prompt=consent&session_state=649633da41c6148080506e104abef8e1262c76d8..3c52 req_id=100622cd-aa54-c5dd-feb5-0e7a4a211653 service=authenticate size=19 status=404 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
{"level":"warn","Addr":":5443","GRPCAddr":":5443","time":"2020-02-04T16:01:28Z","message":"config: default http handler changed"}
{"level":"warn","time":"2020-02-04T16:01:28Z","message":"config: insecure mode enabled"}
4:01PM INF cmd/pomerium version=v0.6.0+36abc9f
4:01PM ??? autocache: with options: &{PoolOptions:<nil> PoolScheme:http PoolPort:8333 PoolTransportFn:0xc7ad30 PoolContext:<nil> MemberlistConfig:<nil> Logger:0xc00035a7d0} service=autocache
4:01PM ??? autocache: defaulting to lan configuration service=autocache
4:01PM ??? autocache: self addr is: 10.245.186.139 service=autocache
4:01PM ??? autocache: groupcache self: http://10.245.186.139:8333 options: &{BasePath: Replicas:0 HashFn:<nil>} service=autocache
4:01PM INF internal/httputil: http server started addr=:8333
4:01PM ??? [WARN] memberlist: Failed to resolve pomerium-cache-service.default.svc.cluster.local: lookup pomerium-cache-service.default.svc.cluster.local on 10.112.0.10:53: no such host service=autocache
4:01PM ??? [DEBUG] memberlist: Initiating push/pull sync with: 10.245.186.139:7946 service=autocache
4:01PM ??? [DEBUG] memberlist: Stream connection from=10.245.186.139:33496 service=autocache
4:01PM WRN internal/grpc: serving without TLS addr=:443
4:01PM INF internal/grpc: registered grpc-service-info={"cache.Cache":{"Metadata":"cache.proto","Methods":[{"IsClientStream":false,"IsServerStream":false,"Name":"Get"},{"IsClientStream":false,"IsServerStream":false,"Name":"Set"}]}}
4:01PM INF internal/httputil: http server started addr=:5443
10.12.51.32 - [10.12.51.32] - - [04/Feb/2020:17:30:06 +0000] "GET / HTTP/2.0" 302 266 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15" 613 0.002 [default-pomerium-proxy-service-https] [] 10.245.186.140:443 266 0.002 302 57b471b59ce90dea23792f3f9bae3826
10.12.51.32 - [10.12.51.32] - - [04/Feb/2020:17:30:17 +0000] "GET /.pomerium/sign_in?pomerium_expiry=1580837706&pomerium_issued=1580837406&pomerium_redirect_uri=https%3A%2F%2Fhttpbin.domain.com%2F&pomerium_signature=T4lNcKSpX8INM-Hv5wwlZCgWRA_iBsJPNRg8saMTRv0%3D HTTP/2.0" 302 848 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15" 1530 10.849 [default-pomerium-authenticate-service-https] [] 10.245.8.232:443 848 10.849 302 2ebf120f914258214ec9bdb15f8bef62
10.12.51.32 - [10.12.51.32] - - [04/Feb/2020:17:30:33 +0000] "GET /oauth2/callback?state=aVdGaWZPcEwxQ2ZwTG51V1Y5T0JmWmkyRnBPczA5NDNINlpNL1Q1VjN1VFdTZkFPS0daQ2dmb29WZ0ZaR1ZlZGZGYUE3TWsvS1VWZXBvMXFDM3Y5V3c9PXwxNTgwODM3NDE3fIU87t8oJME1PaPHNFIcPqA0sQjuihWXcctzpMmNHQGN9pH6HrwIRzYBcM3FeH6StTKLfBQOp5brLOdk9IzeZ2q3C_jHwDjCmlIt9Q7H5-Pw8b08_x-VWHziZTSDSyaUrrWddA6MPyGaOmvOFY0Y8hnoTfnmgfeZImXz_8MSPCZwJS3Iv_YPl_HAfVEzbJi2hA07cayuQTPzS-3HNgt1WpOvHu1RvdEx9RPlLN0rZdD0z_7bCnkgj2V5gbhShHR_OgnLCvH6LSjy6TNs5ubdfAWZlRLzJF0hqYEl8oqOGITODLBMS0Vz2Jw3mAdR6E3YjvSuTqOyGzO53Rk7tcHium4qOulgcYAWBeXySs76X94%3D&code=4/wAFlGpivg7qp0vAMB2co9WXKmvrvOHDvZ1X4QeyBQQVSGhkdd8TcXQh4ol-uIGKoA1uJDF6-zRxS0_oIHuaOdw4&scope=email%20profile%20openid%20https://www.googleapis.com/auth/userinfo.profile%20https://www.googleapis.com/auth/userinfo.email&authuser=0&hd=domain.com&prompt=consent&session_state=649633da41c6148080506e104abef8e1262c76d8..3c52 HTTP/2.0" 500 1510 "https://accounts.google.com/signin/oauth/oauthchooseaccount?client_id=CLIENTID.apps.googleusercontent.com&as=EygV7-0oNF8NbtCiiEcBcA&destination=https%3A%2F%2Fauthenticate.domain.com&approval_state=!ChRhV2NjakhKa3Z0SnIxajN4RllEOBIfUTlibEtUamtVTmNjVUU3MWpGWk5XazB6RmdzVUFSYw%E2%88%99AJDr988AAAAAXjr7qU79hL7ZC_qFwJfP9B3BRLLQ3eBX&oauthgdpr=1&xsrfsig=ChkAeAh8T9dCCt2bhP2uOZclw29tsCbrsmfSEg5hcHByb3ZhbF9zdGF0ZRILZGVzdGluYXRpb24SBXNvYWN1Eg9vYXV0aHJpc2t5c2NvcGU&flowName=GeneralOAuthFlow" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15" 1606 10.398 [default-pomerium-authenticate-service-https] [] 10.245.8.232:443 1510 10.399 500 753db807ac1c1e8f3e65a0e2b54c9998 10.12.51.32 - [10.12.51.32] - - [04/Feb/2020:17:30:33 +0000] "GET /favicon.ico HTTP/2.0" 404 19 "https://authenticate.domain.com/oauth2/callback?state=aVdGaWZPcEwxQ2ZwTG51V1Y5T0JmWmkyRnBPczA5NDNINlpNL1Q1VjN1VFdTZkFPS0daQ2dmb29WZ0ZaR1ZlZGZGYUE3TWsvS1VWZXBvMXFDM3Y5V3c9PXwxNTgwODM3NDE3fIU87t8oJME1PaPHNFIcPqA0sQjuihWXcctzpMmNHQGN9pH6HrwIRzYBcM3FeH6StTKLfBQOp5brLOdk9IzeZ2q3C_jHwDjCmlIt9Q7H5-Pw8b08_x-VWHziZTSDSyaUrrWddA6MPyGaOmvOFY0Y8hnoTfnmgfeZImXz_8MSPCZwJS3Iv_YPl_HAfVEzbJi2hA07cayuQTPzS-3HNgt1WpOvHu1RvdEx9RPlLN0rZdD0z_7bCnkgj2V5gbhShHR_OgnLCvH6LSjy6TNs5ubdfAWZlRLzJF0hqYEl8oqOGITODLBMS0Vz2Jw3mAdR6E3YjvSuTqOyGzO53Rk7tcHium4qOulgcYAWBeXySs76X94%3D&code=4/wAFlGpivg7qp0vAMB2co9WXKmvrvOHDvZ1X4QeyBQQVSGhkdd8TcXQh4ol-uIGKoA1uJDF6-zRxS0_oIHuaOdw4&scope=email%20profile%20openid%20https://www.googleapis.com/auth/userinfo.profile%20https://www.googleapis.com/auth/userinfo.email&authuser=0&hd=domain.com&prompt=consent&session_state=649633da41c6148080506e104abef8e1262c76d8..3c52" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15" 2183 0.002 [default-pomerium-authenticate-service-https] [] 10.245.8.232:443 19 0.002 404 726fd0cbd798da76aa164fb359153689
5:30PM DBG proxy: session state error="internal/sessions: session is not found" X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["httpbin.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] ip=10.245.239.237 req_id=ef705a6d-1089-7882-82e7-21f72653d398 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM DBG proxy: redirectToSignin X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["httpbin.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] ip=10.245.239.237 req_id=ef705a6d-1089-7882-82e7-21f72653d398 url=https://authenticate.domain.com/.pomerium/sign_in?pomerium_redirect_uri=https%3A%2F%2Fhttpbin.domain.com%2F user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
5:30PM DBG http-request X-Forwarded-For=["10.12.51.32"] X-Forwarded-Host=["httpbin.domain.com"] X-Forwarded-Port=["443"] X-Forwarded-Proto=["https"] X-Real-Ip=["10.12.51.32"] duration=0.386087 email= group= host=httpbin.domain.com ip=10.245.239.237 method=GET path=/ req_id=ef705a6d-1089-7882-82e7-21f72653d398 service=proxy size=266 status=302 user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.4 Safari/605.1.15"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment