Can someone give me a high level over view of how gradient descent is used in linear regression? I understand that gradient descent basically finds a local minimum efficiently, but how does that actually help to form a regression to data? Can someone give me an order of events in which the line is actually formed to the data points? i understand how to compute the gradient of a point, just not how that actually helps form the line more efficiently.
What is the role of gradient descent in linear regression?
168 views Asked by Garrett Huff At
1
There are 1 answers
Related Questions in MACHINE-LEARNING
- Trained ML model with the camera module is not giving predictions
- Keras similarity calculation. Enumerating distance between two tensors, which indicates as lists
- How to get content of BLOCK types LAYOUT_TITLE, LAYOUT_SECTION_HEADER and LAYOUT_xx in Textract
- How to predict input parameters from target parameter in a machine learning model?
- The training accuracy and the validation accuracy curves are almost parallel to each other. Is the model overfitting?
- ImportError: cannot import name 'HuggingFaceInferenceAPI' from 'llama_index.llms' (unknown location)
- Which library can replace causal_conv1d in machine learning programming?
- Fine-Tuning Large Language Model on PDFs containing Text and Images
- Sketch Guided Text to Image Generation
- My ICNN doesn't seem to work for any n_hidden
- Optuna Hyperband Algorithm Not Following Expected Model Training Scheme
- How can I resolve this error and work smoothly in deep learning?
- ModuleNotFoundError: No module named 'llama_index.node_parser'
- Difference between model.evaluate and metrics.accuracy_score
- Give Bert an input and ask him to predict. In this input, can Bert apply the first word prediction result to all subsequent predictions?
Related Questions in LINEAR-REGRESSION
- Batch Gradient Descent algorithm in python is returning huge values
- Error in running a multi-level mixed effects model on microbiome data
- How can I improve R2 score in my regression model? Predicting House Prices
- I have two dataframes representing two different time points. I want to run a linear regression model with data from both time points
- GMMAT model fit and AIC
- Fitting a curve using Linear regression - CLS and NMF
- Error with WLS estimation in R: missing or negative weights not allowed
- Fitted surface does not resemble the heatmap produced from the same data
- Beta coefficient of direct effect increases after controlling for mediator
- How to exclude abnormal data points and smooth the data before linear fitting
- Performing a simple ridge regression
- Why TukeyHSD test keeps returning NA for a linear model in R?
- Inquiry regarding a linear regression model using Python and pandas
- How to find the x-intercept of Weibull distribution
- PyTorch matrix multiplication shape error: "RuntimeError: mat1 and mat2 shapes cannot be multiplied"
Related Questions in GRADIENT-DESCENT
- Batch Gradient Descent algorithm in python is returning huge values
- Best way of finding KKT points for a Sympy polynomial
- Higher error with smaller batch size in pyTorch
- In Gradient Descent algorithm, how to induce -2*wx
- How to implement gradient op for a custom tensorflow op, for which the it is hard to derive a mathematical closed form formula for gradient?
- The return type of Dual Annealing OptimiseResult 'fun' is float64 and sometimes it is ndarray with single float64
- Gradient descent weights keep getting larger
- Problem with gradient descent least squares code
- How to Implement Full Batch Gradient Descent with Nesterov Momentum in PyTorch?
- Gradients not changing in co-ordinate descent for logistic regression
- Unable to find out the feature importance list from histgradientboosting classifier
- AttributeError: module 'tensorflow_addons.image' has no attribute 'gradients'
- solving Freudenstein and Roth test function using gradient armijo method
- Backpropagation and gradient descent with python
- finding the maximum of a function using jax
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
I found a solid answer here: https://spin.atomicobject.com/2014/06/24/gradient-descent-linear-regression/
The trick to understanding this is knowing that you must compute the m and b value of y = mx+b to develop a cost function, but that gives you a new data set of the best and worst fitting lines. You then use gradient decent to basically find the lowest error line which contains your actual m and b values for the line. This link has a really good graph (in my non professional machine learning opinion) of what the error graph looks like and if you understand gradient decent you can see how it can travel down the graph to find the lowest error. Sorry for jumping the gun on this question but hopefully it can help some others who are new to machine learning!