r/mlpapers • u/SilentDifficulty • Feb 17 '19
r/mlpapers • u/ReaganRewop • Aug 10 '18
Need help with papers...
Hey folks, I am currently in my senior year of U.G in C.S and I am planning to do M.S in A.I. I have very good intern from startups but my c.g.p.a is bad and I don't have any international papers on A.I.
Personally my opinion on papers is that, it shouldn't be your primary purpose. You should find some very good algorithm or approach while doing research or work and, as a contribution to the society, you need to publish it as a paper. Unfortunately, I couldn't find anything that are worth publishing, therefore, forced by society to publish a paper (need it badly for my MS).
So, if you can recommend me some good domains or problem statements to focus my work and publish paper, that would be awesome.
ps: I would also love to contribute to your paper, if you want me to. And, I am writing a paper on block chain, I am not sure whether it will be really valuable to my M.S. and, with 315 to 325 as GRE score, which university do you recommend for A.I or Deep learning?
r/mlpapers • u/sifat577 • Aug 25 '20
Suggestions on how to read and attain information on research papers
Hi everyone. I am a noob at reading research papers. But I am starting to read them. I really would like to know what is the best approach to take in reading and later remembering the vital information from a research paper. How do I keep track of all of this so that I can refer to them and use them later efficiently? Thank you!
r/mlpapers • u/goyabee • Mar 19 '16
An outline of my theories on the mechanisms of human consciousness
First of all, I would like to explain that this post is mostly going to concern what most people would call " artificial consciousness". Personally I think the term "consciousness" is probably the most misunderstood and abused term in the fields of psychology, neurology, and AI research so to preface the discussion, I'd like to specify that by "consciousness" I mean the system in the human brain that controls motivation, allows for the construction of perceptive models, and controls executive processing. I am not a dualist, and as is consistent with evidence, I do not believe that consciousness is anything more than a physical phenomenon in the brain.
Developing an artificial model of these systems in the brain has been a goal of mine for a long time, but as it happened in my lifetime I have failed to get involved with any existing projects and my programming skills have never reached the appropriate level, so I just sort of assumed that someone else (someone with superior programming and systems designing skills) will eventually come up with the same design philosophy within a few years and AI will finally get started. Well, it's been a few years now that I've been checking up on AI and consciousness research and I found that people still seem to be very much in the dark ages to the point that the dualists are still able to get away with their ridiculous claims and no one has really been able to tell them how wrong they are with any considerable degree of certainty. So, having recently come across what I consider to be new and important insights, I have decided to seek out a forum of communication, and share my ideas, hoping to jumpstart someone's creativity enough to help get some models built and tested.
It has become obvious to me, and hopefully to anyone else who takes their involvement in AI research seriously, that step one in developing a model is understanding how consciousness works in the human brain. Here, I'll descibe a few principles that I believe to be the central mechanisms of human consciousness.
First of all, we are always hallucinating. The brain is made up of memory systems and processing systems, one of these memory systems is responsible for holding the information which corresponds to our current perception of reality. This memory system is fed with information which is generated by a separate system of the brain which has access to sensory information. All parts of the brain that respond to the world around us do so by reading information out of this memory system which contains a model of reality, not by accessing sensory information directly, hence everything that we "experience" is a hallucination generated from actual sensory data, and everything that we think we are experiencing is actually a prediction of what a particular system in the brain thinks will happen next. Once the model is read out by other systems of the brain, the accuracy of the prediction is tested against real sensory data and the next prediction is updated to keep it in-line with reality. This theory of brain function is consistent with every phenomenon in which a human enters a hallucinatory state, namely sensory deprivation and drug induced hallucinations. E.g. sensory deprivation deprives the brain of data with which to update its predictive perception model, and drugs such as LSD inhibit the system in the brain which is responsible for performing the update. This causes the algorithms that generate the perception model to run wild and start performing operations on redundant data much like a fractal generation algorithm, hence why fractal hallucinations are so common in these states.
That is what I believe to be the central mechanism behind our brain's perception system, now I will explain how I believe the executive processing system may work, and then I will touch a bit on the importance of implementing dream algorithms in the development of a functional AI consciousness system. The most important aspect of the brain's executive processing system in my opinion is a continuous assessment of pleasure and pain. These don't have to be the words that we use but the idea is that the concept of pleasure and pain is intrinsic to the development of motivation and therefore a necessary element for autonomy. Pleasure and pain are a simple and effective way for the brain to decide what it wants to do and I believe it may be the only effective way to develop true systematic autonomy in machine intelligence as well. I believe the implementation should be very straight-forward so I won't go into great depth to explain the process.
Okay, so finally, what is so important about dreaming? In human beings, dreaming is an essential way to accelerate the learning process. It is a way to press fast forward on experience and develop strategies for how to react to stimuli without having to wait for them to happen in reality and without exposing the body to the dangers of real-world experiences. Certainly the exact way in which the process of dreaming makes use of the same hardware in the brain that is normally used for waking consciousness is something that will have to get ironed out as we go along but I think the basic concept is fairly straightforward. It must be a state of mind similar to the sensory deprivation or the drug-trip states that I mentioned earlier, in that the brain is cut off from all sensory data. The brain shuts off the systems which have access to real-world sensory data and most likely a previously unused system is activated in its place, providing a secondary virtual perception model fed with data from memories which is used to generate world data (mock sensory data) to feed to the primary predictive perception model that is normally used during waking states.
My intention in providing what I hope to be valuable insight is that they may be used to develop functional models in such a way that we may test their function and then modify and add systems as needed in order to avoid the need for expensive brain research to confirm every aspect of what I believe to be a basic universal system which simply cannot work any other way. In other words, I think the way the human brain works isn't just one possible way for it to work, it is perhaps the only way and indeed an effective and efficient way to achieve valuable cognitive phenomena such as learning and creativity. Evolution is known to create systems with none other than the highest possible degree of efficiency.
r/mlpapers • u/rakshith291 • May 23 '21
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
r/mlpapers • u/Feynmanfan85 • Sep 05 '19
Real-time Clustering
Below is an algorithm that can generate a cluster for a single input vector in a fraction of a second.
This will allow you to extract items that are similar to a given input vector without any training time, basically instantaneously.
Further, I presented a related hypothesis that there is a single objective value that warrants distinction between two vectors for any given dataset:
https://derivativedribble.wordpress.com/2019/08/24/measuring-dataset-consistency/
To test this hypothesis again, I've also provided a script that repeatedly calls the clustering function over an entire dataset, and measures the norm of the difference between the items in each cluster.
The resulting difference appears to be very close to the value of delta generated by my categorization algorithm, providing further evidence for this hypothesis.
Code available here:
For those that are interested, here's a Free GUI based app that uses the same underlying algorithms to generate instantaneous machine learning and deep learning classifications:
This app is perfect for a non-data scientist looking to use machine learning and deep learning, and also fun to experiment with for a serious data scientist.
r/mlpapers • u/Feynmanfan85 • Oct 18 '19
Autonomous Noise Elimination
I've updated my autonomous deep learning software to include autonomous noise filtering.
This means that you can give it data that has dimensions that you're not certain contribute to the classification, and might instead be noise. This allows the software to take datasets that might currently produce very low accuracy classifications due to noise, and autonomously eliminate dimensions until it produces accurate classifications.
It can handle significant amounts of noise:
I've given it datasets where 50% of the dimensions were noise, and it was able to uncover the actual dataset within a few minutes.
In short, you can give it garbage, and it will turn into gold, on its own.
It's basically mathematically impossible to beat nearest neighbor using real-world Euclidean data, which was discussed in a previous thread:
https://www.reddit.com/r/compsci/comments/dgkvyy/on_the_nearest_neighbor_method/
And since I've come up with a vectorized implementation of nearest neighbor, this version of the software uses only nearest neighbor-based methods.
As a result, the speed is insane.
If you don't use noise filtering, classifications occur basically instantaneously on a cheap laptop.
If you do have noise, it still takes only a few minutes for a dataset of a few hundred vectors to be processed, even on a cheap laptop.
Code and command line script are available here:
r/mlpapers • u/Flying_Scholars • May 21 '21
[R] A Review of "Neural Anisotropy Directions" (2020)
self.machinelearningr/mlpapers • u/jun_wei_chen • Oct 31 '16
question about implenting SSD (single shot mulitbox detector)
recently i am working on the project to implement SSD (single shot multibox detector), and i have a few point still can't understand, hope someone could give me answer
question 1 : how is the sample presented, do i need to assign a number " 1 - iou " for background ?
for example i got 3 classes , [ background, class a, class b ]
if the iou between box and groundtruth is 0.7 and is class b , which sample shoud i set [ 0.3, 0.7, 0] , or just [ 0, 0.7, 0 ] ?
when iou = 0.1 , [0.9, 0.1, 0] or [0, 0.1, 0]
i train with " 1 - iou " , but when i test with the model, it seems the highest confidence box would like [ 0.4xxx, 0.5xxx , 0 ], even the bounding box match the groundtruth with high accuracy
and i try another method
if iou > 0.5 set sample to 1 iou < 0.5 set sample to 0
for example if iou = 0.7, 0.7 > 0.5 , so sample = [0 , 1 , 0] ,
and if iou = 0.3, 0.3 < 0.5 , so sample = [1 , 0 , 0] but the result is that many box with high confidence is not that accuracy can anyone explain how the negative sample presented
question 2 : which confidence is the network output ?
is the output of network a default box confidence or a predicted confidence ( default box after mapping with predicted x y w h ),
if the output is confidence of default box , it seem it won't know the confidence of the box after mapping
r/mlpapers • u/_panty • Apr 13 '17
Localization for Wireless Sensor Networks: A Neural Network Approach
r/mlpapers • u/Yuqing7 • Dec 07 '20
[N] Open AI’s GPT-3 Paper Shares NeurIPS 2020 Best Paper Awards With Politecnico di Milano, CMU and UC Berkeley
OpenAI’s groundbreaking GPT-3 language model paper, a no-regret learning dynamics study from Politecnico di Milano & Carnegie Mellon University, and a UC Berkeley work on data summarization have been named the NeurIPS 2020 Best Paper Award winners. The organizing committee made the announcements this morning, along with their Test of Time Award, to kick off the thirty-fourth Conference on Neural Information Processing Systems.
NeurIPS 2020 continues through December 12. With 9,467 submitted papers, this has been another record-breaking year for NeurIPS — with 38 percent more paper submissions than 2019. A total of 1,903 papers were accepted, compared to 1,428 last year.
Over the course of the week, participants can virtually join the Expo, where top industry sponsors will provide talks, panels, and demos of academic interest. Tutorials will cover current lines of inquiry while general sessions will include talks, posters, and demonstrations. A full agenda can be found by visiting the NeurIPS conference schedule page.
Here is a quick read: Open AI’s GPT-3 Paper Shares NeurIPS 2020 Best Paper Awards With Politecnico di Milano, CMU and UC
r/mlpapers • u/walid_idk • Sep 15 '20
Publishing a paper
Hi everyone, i hope you're safe and good.
So I recently graduated and for my thesis I worked on ML project and the jury who reviewed the work said it is remarkable and I should publish it... Now this is all new to me and I wanna know a few things:
First, where should I publish it? What journal do you guys recommend?
Second, during my research I tried reimplementing some of the papers i read and sometimes it gave me results different than the author (bad results) as if there was something missing or the neural network architecture wasn't right. Is this a common thing to do? I mean, not mentioning all the parts of the work (i.e. neural network and/or right optimizer/loss function that have been used) because I'm being skeptical about sharing all the details of the model as there is a big possibility of using it commercially and the teacher who had been mentoring me during the project is already putting pressure on me to share the code with him and I'm not really sure about all of that.
Some might argue that since it has potential to be used commercially (startup, or sold to some company) that I shouldn't publish it and commercialize it instead, but the environment (country) I'm living in is so far behind when it comes to startups culture.
Anyone been in same situation before?
Please excuse my English as it's not my native language.
r/mlpapers • u/[deleted] • Mar 23 '19
Human-level control through deep reinforcement learning
storage.googleapis.comr/mlpapers • u/Feynmanfan85 • Sep 17 '19
Autonomous Real-Time Deep Learning
In a previous paper, I introduced a new model of artificial intelligence rooted in information theory that can solve deep learning problems quickly and accurately in polynomial time. In this paper, I’ll present another set of algorithms that are so efficient, they allow for real-time deep learning on consumer devices. The obvious corollary of this paper is that existing consumer technology can, if properly exploited, drive artificial intelligence that is vastly more powerful than traditional machine learning and deep learning techniques:
https://www.researchgate.net/publication/335870861_Autonomous_Real-Time_Deep_Learning
r/mlpapers • u/bodytexture • Sep 13 '19
Anyone has built an AI beauty context jet? Which tools to use to start built one that works by submitting a photo to it and have it ranked?
r/mlpapers • u/[deleted] • Sep 30 '19
A PyTorch implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).

GitHub: https://github.com/benedekrozemberczki/AttentionWalk
Paper: https://papers.nips.cc/paper/8131-watch-your-step-learning-node-embeddings-via-graph-attention.pdf
Abstract:
Graph embedding methods represent nodes in a continuous vector space, preserving different types of relational information from the graph. There are many hyper-parameters to these methods (e.g. the length of a random walk) which have to be manually tuned for every graph. In this paper, we replace previously fixed hyper-parameters with trainable ones that we automatically learn via backpropagation. In particular, we propose a novel attention model on the power series of the transition matrix, which guides the random walk to optimize an upstream objective. Unlike previous approaches to attention models, the method that we propose utilizes attention parameters exclusively on the data itself (e.g. on the random walk), and are not used by the model for inference. We experiment on link prediction tasks, as we aim to produce embeddings that best-preserve the graph structure, generalizing to unseen information. We improve state-of-the-art results on a comprehensive suite of real-world graph datasets including social, collaboration, and biological networks, where we observe that our graph attention model can reduce the error by up to 20%-40%. We show that our automatically-learned attention parameters can vary significantly per graph, and correspond to the optimal choice of hyper-parameter if we manually tune existing methods.
r/mlpapers • u/machineLearningNovic • Jan 04 '16
[Discussion] How to implement this paper?
Hi,
I would like to implement this paper which is highly interesting.
I would like to implement this paper using rapidminer:
http://www.doc.ic.ac.uk/teaching/distinguished-projects/2015/m.sipko.pdf
What do you think?
r/mlpapers • u/Yuqing7 • Dec 13 '19
Weekly Papers | Praising PyTorch; Improving Lip Reading; Generating Structured Text and More
r/mlpapers • u/skuser104 • Apr 20 '20
[Paper] Representation Learning of Histopathology Images using Graph Neural Networks
Paper accepted for #CVPR2020 Workshop achieved SoTA accuracy for lung cancer sub-type classification using entire Whole Slide Images (WSI).
Title: "Representation Learning of Histopathology Images using Graph Neural Networks"
Preprint: https://arxiv.org/abs/2004.07399
r/mlpapers • u/rakshith291 • May 23 '21
MLP-Mixer: An all-MLP Architecture for Vision
Quick summary of the paper https://rakshithv.medium.com/mlp-mixer-an-all-mlp-architecture-for-vision-70ad2cea545f
r/mlpapers • u/agentkirchoff • May 05 '18
We're trying to implement Neumann Optimizer but we're getting bad results.
r/mlpapers • u/skuser104 • Jul 03 '20
Learning Permutation Invariant Representations using Memory Networks
Sharing our recent publication accepted for publication at ECCV'20. We used memory networks and Transformer-like self-attention to model permutation invariant representations of sets. We used these representations to classify extremely high-resolution images in histopathology domains, as well as for point cloud classification.
r/mlpapers • u/[deleted] • Aug 13 '20
Artificial Intelligence-Based Analytics for Diagnosis of Small Bowel Enteropathies and Black Box Feature Detection
r/mlpapers • u/iMakeSense • Nov 07 '14
Fundamental Papers
Are there any fundamental papers a newbie should read to get caught up with the current state of ML?