🕸️ NeuralNetworks

• Added:
• • _2_ 0B00000001-optimization, disabling backpropagation when it's not automatically disabled. helps reduce the size of sketch
• Fixed:
• • Missing MULTIPLY_BY_INT_IF_QUANTIZATION in Layer::FeedForward_Individual(...) (not an issue with EEPROM or PROGMEM)
    
• Improved:
• • Ignore * _inputs during compilation when there's NO_BACKPROP

🕸️ NeuralNetworks

• Fixed:
• • Crucial mistake made in v2.3.6. Forgot to Increment i in destructor (even though I tested it before releasing it)

🕸️ NeuralNetworks

• Fixed:
• • Destructor, deallocating last-layer's outputs when not defined as REDUCE_RAM_DELETE_OUTPUTS resulting in potential unadentified behaviours
    
• Improved:
• • NN.Feedforward(...) logic, reduced program space
• • Reduced program space when NO_BACKPROP and, SD.h not used (above #include <NeuralNetwork.h>)

🕸️ NeuralNetworks

• Improved:
• • REDUCE_RAM_DELETE_OUTPUTS-optimization logic
• • Removed redundant nullification of deleted pointers

🕸️ NeuralNetworks

• Added:
• • _2_OPTIMIZE 0B00000010 aka REDUCE_RAM_STATIC_REFERENCE_FOR_MULTIPLE_NN_OBJECTS. Or in other words: REDUCE_RAM_STATIC_REFERENCE-optimization support for when using multiple NN objects in your sketch interchangeably. Meaning no more need for manual updating of NN.me ...

🕸️ NeuralNetworks

• Added:
• • int16_t&int8_t quantization support (for all storage-medias)
• • Training example with tensorflow + quantization
• • Pre-trained int8_t-quantized NN example
• Fixed:
• • #38 ESP issue with SD.h

🕸️ NeuralNetworks

• Fixed:
• • #37 issue due to binary constants marked as deprecated in new cores
• • FIXED: error: extended character X is not valid in an identifier

Warning

Due to #37 being an issue for many versions of new arduino-cores, I highly-suggest to replace binary-constants in your sketches with the prefix 0 like so: #define _1_OPTIMIZE B00000000 --> #define _1_OPTIMIZE 0B00000000.

🕸️ NeuralNetworks

• Added:
• • Version message during compilation
• • Reminder REDUCE_RAM_WEIGHTS_LVL2 message during compilation
• Fixed:
• • #35 unnecessary inline declaration of array, causing issues with old versions of gcc
• • #34 Misleading message for multiple custom functions
• • Potential ODR violation
• Replaced:
• • ATtiny85 compilation message, with a more important one related to NN.print()

Note

Special thanks to Grzegorz Kuduk for using and referencing my library into his master's thesis "Distributed machine learning in a microcontroller network" ^PDF.

🕸️ NeuralNetworks

Bumping up version because I accidently forgot to do so in library.properties. Otherwise Arduino's library-manager won't show\update-to the latest version. Additionally: updated README.md and resolved another typo, all issues related to previous version should be resolved once it gets updated.

🕸️ NeuralNetworks

• Added:
• • Support for NN without biases
• • Support for Multiple Biases
• • ^^^ ✨ Tensorflow example
• • Optional F() optimization
• Fixed:
• • #26 #28 #29 #30

Note

I want to really thanks @ripred for his kind and honest words, especially for "... You did a great job on this and should be proud.". But also, I want to thanks Ivo Ljubičić for using my library in his ✨ master thesis named "Artificial skin concept for human-robot physical interaction". And last but not least @pjurczen for giving me the spark I needed when he said "... I'd love to see this feature added!".

(Additionally: Note that all feature are compatible with almost all optimization use cases)