E D R , A S I H C RSS

Bigtable기능명세

1.

★★★★★
/
B+ ★★★★★
SCAN ★★★★★
★★★★
read/write
기 ★★★
Tablet Server ★★★
Master Server ★★★
★★
SSTABLE Compaction ★★★
minor compaction
major compaction
구 ★★
구 ★★
Split ★★
heartbeat ★
기 ★

2. ★★★★★

load TS load TS .
TS TS간
규 TS .

2.1.


    1. , cpu rate,
    2. ISSUE : 균+
      1. .

    1. load TS(source) load TS(target)
    2. source 게 target ip
  1. TS
    1. TS
      1. SSTABLE minor compaction
      2. source target ( )

      3. target
    2. 겟 TS

      1. TS
    3. TS
      1. ( )

    1. b+ () 갱
  2. ISSUE
    1. TS ?
    2. target ?
      1. target target .

      1. 게?

3. TS 구 ★★★★★

TS TS TS .
TS

3.1.


    1. TS heartbeat
    2. TS .
      1. (?)과
        1. TS .(<- 만기가 되지 않았다면?)
        2. TS.
        3. target . (? ?)
        4. traget .
  • TS
    1. ( )
  • ISSUE
    1. 까?
      1. 균?
      2. ?

3.2. ISSUE

  • (B+ )
    1. :
    2. :
    3. : target 고 DFS source .
    4. source target .
    5. source .
    6. .
  • target : target . TS .
  • source ? : TS
  • TS : N개
  • DFS
    1. -> DFS
    2. ->

4. ★★★★★

( split) ( TS ) b+ .
client b+ row key .

5. SCAN ★★★★★

. TS .

  1. TS .

5.1.

6. ★★★★


6.1.

6.1.1. read


    1. B+ row TS
  • TS
    1. ROW (ISSUE 6. TS게 ROW )
    2. TS ROW
    3. 결과 merge.
    4. merge결과 String

6.1.2. write


    1. ( ROW TS )
  • TS
    1. row memtable .

7. 기 ★★★

기(write)
(2GB)
공간 -> 공간 memtable minor compaction .
compaction .

7.1.

7.1.1.

  1. memtable
  2. sstable 값 기

7.1.2.

  1. memtable copaction sstable sstable .


7.2.

  1. DFS .
  2. TS 개.

8. TS ★★★

규 TS Locker
Locker TS .

8.1.

  1. Locker
    1. ip
    2. port
    3. ?
  2. Locker ip port# TS .

9. ★★★

.
Locker 고 Locker /거 .
exit();

10. SSTABLE Compaction ★★★

SSTABLE ?

10.1. Minor Compaction

memtable SSTABLE . DFS .

    1. memtable

10.2. Major Compaction

SSTABLE 근 기 .
client
  • ISSUE
    1. SSTABLE 기?
    2. major compaction SSTABLE 1개?

11. 구 ★★

memtable

11.1.

  1. map&reduce TS .
  2. TS (redo).

12. 구 ★★


12.1.

  1. ? .
    1. ISSUE
      1. 게 감?
      2. ?

    1. ISSUE : ?
      1. ? TS?
  2. Locker TS .
  3. Locker .
  4. TS .

13. Split ★★

.

13.1.

  1. 200MB major compaction
    1. split sort .
  2. split
  3. SSTABLE
    1. SSTABLE .
    2. ISSUE
      1. sstable .
      2. merge compaction sstable sstable .

14. ★★

TS .

14.1.

  1. TS . .
  2. 간간격
  3. (Locker )

15. heartbeat ★

TS ( Locker) 간격 .
TS .

  • ISSUE
    1. heartbeat ?
      1. : TS .
      2. :

16. 기 ★

.
겨 기 기(expired) .

16.1.

  1. TS

  2. Locker DFS .

16.2.

  1. 기/

17.







    1. (Locker)
    2. ()
    3. heartbeat 기 ()
    4. ()
    5. ()
    6. 기 ()
    7. 기 ()
    8. 기( )
    9. 기 ( )
    10. 기 (DFS)

18.



    1. /timeout
    2. ID

    1. (ip, port) (Locker)
    2. 규( ) 감 (Locker)
    3. ( )
    4. hearbeat , ( )
    5. ( )

19.

기/
Locker API .


    1. root tablet
    2. meta tablet

    1. root tablet (Locker)
      1. api
    2. ( )
      1. api
    3. ( )
      1. api

20. API

api
.

    1. root table 기 (Locker)
    2. )
      1. b+
      2. row key key
    3. ( )
      1. b+
      2. key:value

21. Locker

/
.





    1. (ip, port)

      1. (ip, port)



22. DFS

key value


    1. SSTableID DFSFileName .
Valid XHTML 1.0! Valid CSS! powered by MoniWiki
last modified 2021-02-07 05:22:36
Processing time 0.0506 sec