I have deployed a go application in kubernetes. My application has a go routine which continuously listens for messages from a kafka topic and push new messages into a go channel for further processing and commits kafka message. If I scale down the number of replicas using hpa/if replica goes down due to panic, what happens to the messages which are still in go channel unprocessed?
What happens to unprocessed messages in go channel on abrupt shutdown?
145 views Asked by klin At
1
There are 1 answers
Related Questions in GO
- Go Fiber and HTMX - HX-Trigger header is changed to Hx-Trigger, which is not what HTMX is listening for
- Golang == Error: OCI runtime create failed: unable to start container process: exec: "./bin": stat ./bin: no such file or directory: unknown
- Handling both JSON and form values in POST request body with unknown values in Golang
- invalid transaction: Transaction failed to sanitize accounts offsets correctly
- Golang lambda upload image into s3 static website
- Is there a way to get a list of selected module versions, but only for modules within the pruned graph?
- Save Interface in DB golang
- ERROR: column "country" is of type text[] but expression is of type record (SQLSTATE 42804)
- Trying to update the version.go file with the release tag from GitHub actions but its failing
- How can I optimize this transposition table for connect 4 AI?
- const declaration - How to evaluate expressions at compile time?
- How add array of authors for unique user in database in Goland IDE?
- Why is the main goroutine not blocked after write in unbuffered channel?
- Insert & Retrieve from a channel in same main function throws "goroutine 1 [chan receive]: main.main() /path exit status 2" error
- Gob error when decoding array of structs: decoding into local type but received remote type
Related Questions in KUBERNETES
- Golang == Error: OCI runtime create failed: unable to start container process: exec: "./bin": stat ./bin: no such file or directory: unknown
- I can't create a pod in minikube on windows
- Oracle setting up on k8s cluster using helm charts enterprise edition
- Retrieve the Dockerfile configuration from the Kubernetes and also change container Java parameter?
- Summarize pods not running, by Namespace and Reason - I'm having trouble finding the reason
- How to get Java running parameters from Spring Boot running inside container in pod where no ps exist
- How do we configure prometheus server to scrape metrics from a pod with Istio sidecar proxy?
- In rke kube-proxy pod is not present
- problem with edge server registration in Eureka
- Unable to Access Kubernetes LoadBalancer Service from Local Device Outside Cluster
- Kubernetes cluster on GCE connection refused error
- Based on my experience, I've outlined the Kubernetes request flow. Could someone please add or highlight any points I might have overlooked?
- how to define StackGres helm chart "restapi" values to use internal LoadBalancer - AWS EKS
- Python3.11 can't open file [Errno 2] No such file or directory
- Cannot find remote pod service - SERVICE_UNAVAILABLE
Related Questions in GOROUTINE
- Insert & Retrieve from a channel in same main function throws "goroutine 1 [chan receive]: main.main() /path exit status 2" error
- How can I send a event to the main loop from a Goroutine?
- How to wait for in process operations before canceling go routine
- Alternatives to kill a goroutine/thread completely externally
- Coordinating error states for multiple goroutines?
- Executing Multiple Instances of Code Snippet at Specific Intervals Using Constant Timestamp
- Why is a data race being reported even if assignment is atomic?
- Capture Stderr and redirect it to Stdout in service with goroutine in go
- custom mutex - all goroutines are asleep - deadlock
- Go sync.WaitGroup doesnt work correctly with chromedp
- Golang go routine run, but different from what i expected
- golang fyne dialog doesn't update on user choice
- How many Goroutines is too many Goroutines?
- Insert Item by using goroutine does not work properly
- Why a Timer variable assigned with time.Afterfunc executes its function even though outer func exits
Related Questions in KUBERNETES-HPA
- How to properly configure averageUtilization of hpa in k8s
- Kubernetes custom HPA on top of cloud watch collected metrics, how to interpret the output?
- Horizontal Pod Autoscaling in Kubernetes Google Cloud with custom metric
- Scale up condition keeps idle pods up
- Kubernetes - Horizontal Pod Scaler error, target "unknown". Message "no recommendation"
- How can I control scale down of pods based on AZ zones in kubernetes HPA (Horizontal Pod Autoscaler)?
- How to suppress 'get hpa' error message when hpa not found?
- Kubernetes customized controller for collaborated auto scaling
- What happens to unprocessed messages in go channel on abrupt shutdown?
- Kubernetes hpa with external metric. My external metric is not returning correct value
- How to configure Horizontal Pod Autoscaler to fit pods to a node?
- GKE autoscaler overwrites my HorizontalPodAutoscaler in infinite loop
- GKE killing pods when there is more than 5 of them
- KEDA - how does redis listLength scale pods (in detail)
- Kubernetes Spare/Cold Replica/Pod
Related Questions in CONFLUENT-KAFKA-GO
- Parallel Kafka consumer in Go without partition-level parallelism
- Kafka consumer not pausing when needed
- Golang Apache Kafka ConfluentInc not building on MacOS
- Reading kafka messages in batch by using conn.ReadBatch in kafka-go and manual offset management
- docker-compose - kafka:9092/1: Failed to resolve 'kafka:9092': nodename nor servname provided,
- Unable to connect to Confluent Kafka using segmentio's kafka-go
- "Invalid replication factor" in confluent Kafka Go Client
- Confluent Cloud Kafka Go v2.1.1 : ssl/certs and unregistered scheme error
- Unclear behavior when using async Kafka writer and RequiredAcks set to RequireNone in segmentio/kafka-go
- Kafka golang consumers do not rebalance as expected
- Does Confluent kafka go package compatible with ubuntu 22.04?
- How can I fix my docker build failing while my go build succeeds? Dockerfile includes go mod download
- Resolving InvalidTimestampException with Confluent-Kafka-Go v1.8.x and Kafka v3.2.x: Seeking Clarification on Timestamp and Leader Epoch Issues
- How to add Replication factor to a topic?
- confluent-kafka-go consumer batch commits
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
The channels in go are in the memory, so when the app crashes, everything in the channels will be lost.