构建一个仅基于Numpy的简单神经网络
构建一个仅基于Numpy的简单神经网络
Python 机器学习
共114Star
详细介绍
Simple Neural Networks
This is a repo for building a simple Neural Net based only on Numpy.
The usage is similar to Pytorch. There are only limited codes involved to be functional. Unlike those popular but complex packages such as Tensorflow and Pytorch, you can dig into my source codes smoothly.
The main purpose of this repo is for you to understand the code rather than implementation. So please feel free to read the codes.
Simple usage
Build a network with a python class and train it.
import neuralnets as nn
class Net(nn.Module):
def __init__(self):
super().__init__()
self.l1 = nn.layers.Dense(n_in=1, n_out=10, activation=nn.act.tanh)
self.out = nn.layers.Dense(10, 1)
def forward(self, x):
x = self.l1(x)
o = self.out(x)
return o
The training procedure starts by defining a optimizer and loss.
net = Net()
opt = nn.optim.Adam(net.params, lr=0.1)
loss_fn = nn.losses.MSE()
for _ in range(1000):
o = net.forward(x)
loss = loss_fn(o, y)
net.backward(loss)
opt.step()
Demo
- A naked and step-by-step network without using my module.
- Train regressor
- Train classifier
- Train CNN
- Save and restore a trained net
Download or fork
Download link
Fork this repo:
$ git clone https://github.com/MorvanZhou/simple-neural-networks.git