TechQA.

sparse gradient in text classification with pytorch

76 views Asked by At

I am trying to train a text classification module.

When I use Adam, RAdam, or RMSProp for my optimizer, I get the following error:

RuntimeError: Adam/RAdam/RMSProp does not support sparse gradients

So I tried using SparseAdam and I got this error:

RuntimeError: SparseAdam does not support dense gradients, please consider Adam instead

How can I solve this issue?

optimization pytorch nlp text-classification torchtext
Original Q&A
0

There are 0 answers

Related Questions in OPTIMIZATION

Related Questions in PYTORCH

Related Questions in NLP

Related Questions in TEXT-CLASSIFICATION

Related Questions in TORCHTEXT

Popular Questions

Popular Tags

javascript python java c# php android html jquery c++ css ios sql mysql r reactjs node.js arrays c asp.net json

Trending Questions