Here's a list of some plants that will grow in Zone 2.

White Tree Peony (Paeonia suffruiticosa)
Sweet Alyssum (Lobularia maritima)
Maltese Cross (Lychnis chalcedonica)
Bell Pepper (Capsicum annuum "Golden Summer")
Paper birch (Betula papyrifera)
Redosier Stolinifera Dogwood (Cornus stolinifera)
Blanket Flower (Gaillardia x grandiflora 'The Sun')