It is not fair to burden innocent people, either through taxes or reduced services, because their ancestors may or may not have been guilty of crimes against another racial group. Also, indiscriminately giving preference to people who claim membership of a particular racial group when the individuals involved may not have suffered injustice cannot ethically be justified.
In the case of Australian Aborigines (or Aboriginal people or First Nations people if you prefer the fashionable phrases) how could you possibly decide who was, and who was not, justified in claiming membership of the group?
The only fair way of treating the people of Australia (or any other nation) is to give all equal rights irrespective of their race, creed or political leaning.
Individuals who have been treated unjustly deserve justice whatever their race, creed or political leaning.
Individuals who are in particular need should all be looked after humanely whatever their race, creed or political leaning.
On another, but related subject...
We are all First Nations people. For example, it would be amazing if I did not have some ancestors who were among the first people in Britain. It would be totally beyond belief that I had no ancestors who were the first people in Africa; we all have ancestors who were the first people in Africa.