We don't use the terms Department or Region, can I change them to our names?

Yes. Go to Settings > Preferences and the first 4 items allow you to change various terms within Budgyt to better reflect your business.