Ошибка SeldonAPI для модели mlserver, развернутой на Seldon
Я пытаюсь диагностировать ошибку вызова модели, показанную ниже. Ошибка случайная (5-10% трафика). Система Селдона не ограничена памятью или процессором. Кто-нибудь знает, что означает эта трассировка стека?
level=error logger=SeldonRestApi thread=<no value> message=<no value> stacktrace=github.com/seldonio/seldon-core/executor/api/rest.(*SeldonRestApi).predictions
/workspace/api/rest/server.go:330
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func1
/go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/promhttp/instrument_server.go:76
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func1
/go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/promhttp/instrument_server.go:76
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/seldonio/seldon-core/executor/api/rest.handleCORSRequests.func1
/workspace/api/rest/middlewares.go:64
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/gorilla/mux.CORSMethodMiddleware.func1.1
/go/pkg/mod/github.com/gorilla/mux@v1.8.0/middleware.go:51
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/seldonio/seldon-core/executor/api/rest.xssMiddleware.func1
/workspace/api/rest/middlewares.go:87
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/seldonio/seldon-core/executor/api/rest.(*CloudeventHeaderMiddleware).Middleware.func1
/workspace/api/rest/middlewares.go:47
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/seldonio/seldon-core/executor/api/rest.puidHeader.func1
/workspace/api/rest/middlewares.go:79
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2047
github.com/gorilla/mux.(*Router).ServeHTTP
/go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210
net/http.serverHandler.ServeHTTP
/usr/local/go/src/net/http/server.go:2879
net/http.(*conn).serve
/usr/local/go/src/net/http/server.go:1930