I have run into this same problem. The way around it that works for me so far is to unequip both main and off hand, then re-equip with the new ones. Trying to equip from inventory just puts the dagger in the main hand. I have the same problem with rings.