기존 네트웍을 좀 개선했다.
- 현재 상태를 입력 -> 현재 상태, 과거 상태 입력.
- 네트웍 구조 단순화. 3개 층
- dropout 적용.
환경설정에서 이번 행동이 의미있는 행동이라면 벌점을 상쇄하고 득점하도록 설정.이렇게 하면 call만 학습한다!!- 최대 삽질 수량을 증가. 단순하게 하면 에피소드를 끝까지 보낼 수 없어 정확하게 판단할 수 없어 보임.
- global network 횟수 증가, 한번 업데이트 시 단위 에피소드 감소(100개에서 20개)
- 성공 리워드를 2,000점, 실패시 -100점, 매 턴마다 -30점 획득 설정.
기존에 최대 성공 800회/최대 1,000회 에서 940번 성공까지 올랐다. 네트웍을 장난질 하면 더 올라갈 수 있어 보인다.
이렇게 하니, Actino.put 동작이 없어졌다. 가산점을 얻기 위해서 get만 실행하는 듯 하다!! 대차가 뒤쪽에 있는 경우(Y1 선) 여전히 삽질한다.
전 시도가 망한 듯 하여 하루동안 다시 학습 시켰다.(20. 12. 18)
- 현재 상태를 입력 -> 현재 상태, 과거 상태 입력.
- 네트웍 구조 단순화. 3개 층.
- dropout 적용 0.8 적용.
- 환경설정에서 이번 행동이 의미있는 행동이라면 벌점을 상쇄하고 득점하도록 설정.
-> getX1, X2, X3을 했을 경우 nextType과 앞 열 대차가 일치하면 추가 점수 획득.
-> DQN 도 연속된 4장 사진을 입력으로 받아들이는데, 중간 행동에 대한 평가를 추가. - 최대 삽질 수량을 5로 감소.(전에 8번동안 공대차를 call하고 실패하면 벌점 100점 획득)
(단순하게 하면 에피소드를 끝까지 보낼 수 없어 정확하게 판단할 수 없어 보임.) - global network 횟수 증가, 한번 업데이트 시 단위 에피소드 감소(100개에서 20개)
- 성공했을 경우 reward를 감소. 2,000점에서 200점으로 수정.
- 성공 점수를 200점으로 내리면 웬만한 문제는 3턴 안에 해결한다.
- get과 put이 있는데, put은 포기하고 대부분 대차 순환으로 해결한다.
- put을 왜 실행하지 않는지 모르겠다. 가산점을 얻기 위해서인지..
20.12.20. update
왜 put을 안 하는지 알았다. 시스템 설계를 잘못해서 put 없이도 문제를 풀 수 있다. get으로 공간을 만들어 채우면 모두 풀 수 있다! 와!! 똑똑한데… 예상과 다르게 환경 설정함이 어렵다.
모델 <_io.TextIOWrapper name='./201208ActorA3c.json' mode='r' encoding='UTF-8'>를 로딩 저장된 weights ./201208weightCriticA3c.h5를 로딩 seed 현재 state는: 719 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 4931 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 0 score: 220 현재 state는: 6028 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 6026 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 1 score: 170 현재 state는: 2775 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 2 score: 200 현재 state는: 626 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 4919 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 3 score: 220 현재 state는: 4769 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 현재 state는: 6173 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 4 score: 220 현재 state는: 783 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 5 score: 200 현재 state는: 4467 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 6 score: 200 현재 state는: 2140 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2138 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 7 score: 170 현재 state는: 2029 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2030 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 8 score: 170 현재 state는: 358 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 356 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 9 score: 170 현재 state는: 6438 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 10 score: 200 현재 state는: 3821 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 11 score: 200 현재 state는: 1521 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 12 score: 200 현재 state는: 4206 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 13 score: 200 현재 state는: 4260 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 14 score: 200 현재 state는: 1232 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 15 score: 200 현재 state는: 1111 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1112 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 16 score: 170 현재 state는: 5491 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 17 score: -100 현재 state는: 4433 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 18 score: 200 현재 state는: 5455 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 5459 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 19 score: 170 현재 state는: 4568 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 20 score: 200 현재 state는: 2583 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 21 score: 200 현재 state는: 1945 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1949 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 22 score: 170 현재 state는: 5592 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 23 score: 200 현재 state는: 1155 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 24 score: 200 현재 state는: 1463 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 25 score: 200 현재 state는: 2569 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2570 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 현재 state는: 3977 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 26 score: 190 현재 state는: 1720 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1724 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 27 score: 170 현재 state는: 951 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 28 score: 200 현재 state는: 1519 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1517 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 29 score: 170 현재 state는: 994 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 995 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 30 score: 170 현재 state는: 825 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 31 score: 200 현재 state는: 2258 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 32 score: 200 현재 state는: 4803 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 33 score: 200 현재 state는: 6522 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 34 score: 200 현재 state는: 1245 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 35 score: 200 현재 state는: 2573 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 36 score: 200 현재 state는: 1957 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1958 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 37 score: 170 현재 state는: 3435 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 38 score: 200 현재 state는: 3788 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 39 score: 200 현재 state는: 5757 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 40 score: 200 현재 state는: 1965 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 41 score: 200 현재 state는: 4411 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4415 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 42 score: 170 현재 state는: 3345 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 43 score: 200 현재 state는: 1003 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1004 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 44 score: 170 현재 state는: 388 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 392 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 4685 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 45 score: 190 현재 state는: 2539 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2543 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 현재 state는: 3974 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 46 score: 190 현재 state는: 4626 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 47 score: 200 현재 state는: 1848 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 48 score: 200 현재 state는: 2860 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2858 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 49 score: 170 현재 state는: 37 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 41 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 50 score: 170 현재 state는: 4764 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 51 score: 200 현재 state는: 6254 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 52 score: 200 현재 state는: 1258 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1256 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 53 score: 170 현재 state는: 5043 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 54 score: 200 현재 state는: 4767 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 55 score: 200 현재 state는: 1363 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1364 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 5657 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 56 score: 190 현재 state는: 71 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 57 score: 200 현재 state는: 529 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 527 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 58 score: 170 현재 state는: 6133 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 6134 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 59 score: 170 현재 state는: 4622 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 60 score: 200 현재 state는: 717 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 61 score: 200 현재 state는: 1787 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 62 score: 200 현재 state는: 1348 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1346 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 5639 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 63 score: 190 현재 state는: 4146 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 64 score: 200 현재 state는: 2629 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2633 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 현재 state는: 4064 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 65 score: 190 현재 state는: 6541 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 6539 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 66 score: 170 현재 state는: 4447 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4451 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 67 score: 170 현재 state는: 1270 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1274 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 68 score: 170 현재 state는: 168 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 69 score: 200 현재 state는: 6298 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 6296 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 70 score: 170 현재 state는: 2362 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 2363 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 71 score: 170 현재 state는: 709 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 707 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 72 score: 170 현재 state는: 3446 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 73 score: 200 현재 state는: 190 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 194 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 74 score: 170 현재 state는: 4306 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4307 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 75 score: 170 현재 state는: 5499 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 76 score: 200 현재 state는: 519 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 77 score: 200 현재 state는: 1958 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 78 score: 200 현재 state는: 25 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 23 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 79 score: 170 현재 state는: 5428 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 5432 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 80 score: 170 현재 state는: 5984 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 현재 state는: 6458 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 81 score: 220 현재 state는: 3982 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 3983 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 82 score: 170 현재 state는: 5007 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 83 score: 200 현재 state는: 181 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 185 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 84 score: 170 현재 state는: 4753 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4757 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 85 score: 170 현재 state는: 4532 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 현재 state는: 5939 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 86 score: 220 현재 state는: 2544 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 87 score: 200 현재 state는: 100 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 104 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 88 score: 170 현재 state는: 1672 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 1670 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 5885 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 89 score: 190 현재 state는: 687 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 90 score: 200 현재 state는: 835 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 833 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 5126 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 91 score: 190 현재 state는: 4689 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 92 score: 200 현재 state는: 827 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 현재 state는: 5117 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeB: 1>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 93 score: 220 현재 state는: 1197 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeA: 0>||<Carrier.typeB: 1>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeV: 3>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 94 score: 200 현재 state는: 4636 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeA: 0>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4640 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX2 episode: 95 score: 170 현재 state는: 2352 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeB: 1>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 96 score: 200 현재 state는: 5028 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeV: 3>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeA: 0>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 episode: 97 score: 200 현재 state는: 4435 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeV: 3>|| ||<Carrier.typeB: 1>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3Y3 현재 state는: 4433 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX3 episode: 98 score: 170 현재 state는: 4676 [32m X1 X2 X3[0m [32m ==============================================================[0m [32mY1||<Carrier.typeV: 3>||<Carrier.typeA: 0>||<Carrier.typeB: 1>||[0m [32m ==============================================================[0m [32mY2||<Carrier.typeA: 0>||<Carrier.typeV: 3>||<Carrier.typeA: 0>||[0m [32m ==============================================================[0m [32mY3||<Carrier.typeB: 1>|| ||<Carrier.typeV: 3>||[0m [32m ====================== =====================[0m [32m ==nextType:<Carrier.typeA: 0>[0m action is Action.getX1 episode: 99 score: 200