In the lexicographicqlearning.py file in your text_gym file, there are constraints when defining objects, and what do constraints represent? This is the “constraints” in the first line of the code below
self.env = env
self.model_name = model_name
action_size = self.env.action_space.n
state_size = self.env.observation_space.n
constraint_size = len(constraints)
self.constraints = constraints
self.qtable_constraints = np.zeros((constraint_size, state_size, action_size))
self.qtable = np.zeros((state_size, action_size))
self.avg_time = 0
self.steps_per_episode = 1000
self.gamma = None`