You can choose a model without an intercept to avoid linear dependency between columns.