They can be obtained through simulations (by defeating enemies or simply finding ones scattered throughout). A greater amount can be obtained through Sub-games, Virus battles and the sub-game that plays outside Lun Infinus after collecting six items.
There are two types of bits that can be found. Yellow are the most common and are valued at 1. A less common Red variation can be found and are valued at 5.