Dragging/Dropping columns into new position

This may have already been asked but if I'm looking at a list on incidents on the incidents tab, i want to be able to see the incident # first.  Currently, i am seeing the incident name 1st.  I dragged and dropped the # column so that it is displayed 1st, however, if i go to another page and come back to incidents, the column order that i had set up is gone.  How can i set up the columns in the order that i want them to display and lock the orderf down?