I have text classification problem with over 20k features, 3m objects, and over 3k classes. Data is very sparse. I wrote the program on R. Data matrix in sparseMatrix object. How can I select features on this data? I found package FSelector, but it is not working with sparseMatrix, only data.frame, and I can not convert data due to memory limitation.
How to do feature selection on SparseMatrix matrix in R
647 views Asked by Osm At
1
There are 1 answers
Related Questions in R
- How to make an R Shiny app with big data?
- How do I keep only specific rows based on whether a column has a specific value?
- Likert scale study - ordinal regression model
- Extract a table/matrix from R into Excel with same colors and stle
- How can I solve non-conformable arguments in R netmeta::discomb (Error in B.matrix %*% C.matrix)?
- Can raw means and estimated marginal means be the same ? And when?
- Understanding accumulate function when .dir is set to "backwards"
- Error in if (nrow(peaks) > 0) { : argument is of length zero Calls: CopywriteR ... tryCatch -> tryCatchList -> tryCatchOne -> <Anonymous> Execution ha
- How to increase quality of mathjax output?
- Convert the time intervals to equal hours and fill in the value column
- How to run an R function getpoints() from IPDfromKM package in an R shiny app which in R pops up a plot that utilizes clicks to capture coordinates?
- Replace NA in list of dfs in certain columns and under certain conditions
- R and text on Cyrillic
- The ts() function in R is returning the correct start and frequency but not end value which is 1 and not 179
- TROUBLING with the "DROP_NA" Function
Related Questions in SPARSE-MATRIX
- cov2corr() for scipy sparse matrices
- Saving a scipy.sparse matrix directly as a regular txt file
- Parallelize nested loop with running sum in Fortran
- How should very large but highly symmetric arrays be handled in Python?
- Sum each column of a sparse matrix multiplied by a vector
- Iterative Matrix-Vector Product Eigensolvers in Python
- Recovering explicit zeros from Scipy MST
- How to compute （row) basis of a sparse matrix in Eigen library?
- Inconsistent results when using Scipy Minimum Spanning tree with sparse and dense inputs
- Bug in large sparse CSR binary matrices multiplication result
- Stitching together overlapping arrays in scipy
- Sampling from a Normal distribution with sparse covariance matrix
- Why EIGS is not able to reproduce the same result as EIG for a generalised eigenvalue problem?
- Create blockwise shifted sparse matrix in matlab directly
- Manipulating sparse matrices in Swift before solving system
Related Questions in FEATURE-SELECTION
- Feature Selection with Random Forest and R Package 'Ranger' / interpretation of function 'variable.importance'
- Dynamically set K value of SelectKBest
- ANOVA Feature Selection
- Trying to use the multiprocessing library in Python but I am running into issues where it freezes but throws no error
- Catia Macro - select all ''non'' updated features
- Pycaret : Got Missing Value error in target col
- Is there a way to retrieve coefficients of SequentialFeatureSelection after model fit?
- Unable to find out the feature importance list from histgradientboosting classifier
- Feature selection with boruta python package
- Feature selection using backward feature selection in scikit-learn and PCA
- Training feature matrix vs Real input
- Feature selection using GI (Gini Importance) and MIC(Maximum Information Coefficient)
- How to select n columns from a matrix minimizing a given function
- WEKA Caim package
- Relation between Jacobians and gradients of neural network's forward pass w.r.t. inputs
Related Questions in FSELECTOR
- Install FSelector in R Notebook Databricks
- Error about loading the ‘FSelector’ package
- Install R package - FSELCETOR on SUSElinux server
- R library(FSelector) failed to run due to java error
- A duplicate bin range was detected. Try increasing the bin range precision
- Unable to run information.gain
- Chi-squared feature selection using Fselector in R
- Error after deleting NA values twice, first by using pandas library second by R
- How to select only the best features by setting up the threshold using FSelector information gain in R language?
- Regarding usage of sparse matrix as an input in Fselector package
- Feature selection in document-feature matrix by using chi-squared test
- How to do feature selection on SparseMatrix matrix in R
- How to properly calculate all weights with FSelector package?
- Unable to use FSelector package in R on mac OS X El Capitan
- Invalid prediction for "rpart" object Error
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Please take a look at:
FSelector:
https://cran.r-project.org/web/packages/FSelector/FSelector.pdf
varSelRF:
https://cran.r-project.org/web/packages/varSelRF/varSelRF.pdf
R, correlation matrix filters, PCA & backward selection:
http://www.r-bloggers.com/introduction-to-feature-selection-for-bioinformaticians-using-r-correlation-matrix-filters-pca-backward-selection/