From my talk at the
@CompSustNet NeurIPS workshop: The importance of impact-driven innovation in addition to methods-driven innovation.
This paradigm of research is essential in AI for climate and biodiversity - and it also leads to groundbreaking new algorithms.
ALT A slide entitled "Paradigms for ML innovation" with the following text.
Typical paradigm:
- Use stereotyped benchmark datasets
- Measure success solely by classification accuracy, test loss, etc.
- Problem-agnostic techniques large amounts of training / fine-tuning data
- Bigger models generally better
Impact-guided innovation
- Use data from real problems
- Measure success based on how algorithm will be used in practice (e.g. speed, robustness, interpretability)
- Leverage additional information wherever possible
- Incorporate constraints
- Build smarter, not (just) bigger
- Collaboration with domain experts in framing problems, designing algorithms, and preparing pathway to deployment