E D R , A S I H C RSS

Bigtable기능명세

1.

★★★★★
/태
B+ 트 ★★★★★
SCAN ★★★★★
★★★★
read/write
★★★
Tablet Server ★★★
Master Server ★★★
★★
SSTABLE Compaction ★★★
minor compaction
major compaction
★★
★★
Split ★★
heartbeat ★


2. ★★★★★

load TS load TS.
TS TS
TS .

2.1.


    1. , cpu rate,
    2. ISSUE : 평+
      1. .

    1. load 큰 TS(source) load TS(target)
    2. source target ip 할 태
  1. TS
    1. TS
      1. SSTABLE minor compaction
      2. source target ( )
      3. 한 태
      4. target
    2. TS

      1. TS
    3. TS
      1. ( 트)

    1. b+ 트()
  2. ISSUE
    1. TS ?
    2. target ?
      1. target target .

      1. 할 태 ?

3. TS ★★★★★

TS TS TS .
TS

3.1.


    1. TS heartbeat
    2. TS .
      1. 한 태 (트태?)
        1. TS .(<- 만기가 되지 않았다면?)
        2. TS함.
        3. target . ( ? ?)
        4. traget .
  • TS
    1. ( 트)
  • ISSUE
    1. ?
      1. ?
      2. ?

3.2. ISSUE

  • (B+ 트 )
    1. :
    2. :
    3. 트 : target DFS source .
    4. source target 한 태 .
    5. source 트한.
    6. 트한.
  • target : target 택. TS .
  • source ? : TS
  • TS 할 태 : 태 N
  • DFS
    1. -> DFS
    2. 패한 태 ->

4. ★★★★★

( split) ( TS ) b+ 트 .
client b+ 트 해 row key 탐 .

5. SCAN ★★★★★

. TS .

  1. TS .

6. ★★★★


6.1.1. read


    1. B+트 row TS
  • TS
    1. ROW (ISSUE 6. 클 TS ROW )
    2. TS ROW
    3. merge.
    4. merge String

6.1.2. write


    1. (태 ROW 통해 TS)
  • TS
    1. row memtable .

7. ★★★

(write)
한(2GB)
-> 한 memtable minor compaction .
compaction .

7.1.1.

  1. memtable
  2. sstable

7.1.2.

  1. memtable copaction sstable sstable .


7.2.

  1. DFS .
  2. TS.

8. TS ★★★

TS Locker
Locker 해 TS .

8.1.

  1. Locker
    1. ip
    2. port
    3. ?
  2. Locker ip port# TS .

9. ★★★

.
Locker Locker / .
exit();

10. SSTABLE Compaction ★★★

SSTABLE ?

10.1. Minor Compaction

memtable 행할 SSTABLE 환. 파형태 DFS .

    1. memtable

10.2. Major Compaction

SSTABLE .
client
  • ISSUE
    1. SSTABLE 합 ?
    2. major compaction SSTABLE 1?

11. ★★

memtable

11.1.

  1. map&reduce TS .
  2. TS 행(redo)한.

12. ★★


12.1.

  1. ? .
    1. ISSUE
      1. ?
      2. ?

    1. ISSUE : ?
      1. ? TS?
  2. Locker TS .
  3. Locker 트태 .
  4. TS .

13. Split ★★

.

13.1.

  1. 200MB major compaction
    1. split sort .
  2. split한
  3. SSTABLE
    1. SSTABLE .
    2. ISSUE
      1. sstable .
      2. merge compaction sstable sstable .

14. ★★

TS .

14.1.

  1. TS . .

  2. (Locker )

15. heartbeat ★

TS ( Locker) 패킷.
TS .

  • ISSUE
    1. heartbeat ?
      1. : TS .
      2. :

16.

.
(expired) .

16.1.

  1. TS

  2. Locker DFS .

16.2.

  1. /

17.







    1. (Locker)
    2. ()
    3. heartbeat ()
    4. 할 (태)
    5. (태)
    6. (클트)
    7. (클트)
    8. (태 )
    9. (태 )
    10. (DFS)

18.



    1. /timeout
    2. ID

    1. (ip, port) (Locker)
    2. ( 패) (Locker)
    3. (태 )
    4. hearbeat 크, 화 (태 )
    5. (태 )

19.

/
Locker 트 API.


    1. root tablet
    2. meta tablet

    1. root tablet (Locker)
      1. 트 api
    2. (태 )
      1. 트 api
    3. (태 )
      1. 트 api

20. 트 API

api
.

    1. root table (Locker)
    2. )
      1. b+ 트
      2. row key key
    3. (태 )
      1. b+ 트
      2. key:value

21. Locker

/
함.



    1. 트 태

    1. (ip, port)

      1. (ip, port)

    2. 트 태

22. DFS

key value


    1. SSTableID DFSFileName 환한.
Valid XHTML 1.0! Valid CSS! powered by MoniWiki
last modified 2021-02-07 05:22:36
Processing time 0.0517 sec