talksik/mediapipe
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,288 Commits 9 Branches 53 Tags
f2dfa7f474d467b57719fe01b99539c4ff2fa4ae
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jiuqiang TangandCopybara-Service 172b360478 Remove unused variable 'input_num'. 
PiperOrigin-RevId: 513009671
 2023-02-28 12:37:03 -08:00
Jiuqiang TangandCopybara-Service 646ab8505a Small fixes to TensorsToImageCalculator. 
PiperOrigin-RevId: 512967357
 2023-02-28 10:11:42 -08:00
Jiuqiang TangandCopybara-Service aa61abe386 Implement TensorsToImageCalculator. 
PiperOrigin-RevId: 512687103
 2023-02-27 11:46:07 -08:00
Jiuqiang TangandCopybara-Service 8a0830ce7b Add "java_package" and "java_outer_classname" to ImageTransformationCalculatorOptions. 
PiperOrigin-RevId: 510720513
 2023-02-18 16:58:56 -08:00
Jiuqiang TangandCopybara-Service 01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator. 
PiperOrigin-RevId: 507748012
 2023-02-07 05:14:42 -08:00
Jiuqiang TangandCopybara-Service f4b0cf1cff Internal change 
PiperOrigin-RevId: 507540898
 2023-02-06 11:48:51 -08:00
Jiuqiang TangandCopybara-Service 8e097ea9c3 Internal changes 
PiperOrigin-RevId: 507016761
 2023-02-03 16:07:42 -08:00
Jiuqiang TangandCopybara-Service 2c4dece023 Internal change 
PiperOrigin-RevId: 505723714
 2023-01-30 10:00:22 -08:00
Jiuqiang TangandCopybara-Service 0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
Jiuqiang TangandCopybara-Service 29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
Jiuqiang TangandCopybara-Service 7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang TangandCopybara-Service 7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Jiuqiang TangandCopybara-Service 8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
Jiuqiang TangandCopybara-Service 5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
Jiuqiang TangandCopybara-Service 25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java. 
PiperOrigin-RevId: 501019327
 2023-01-10 09:45:40 -08:00
Jiuqiang TangandCopybara-Service 6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs 
PiperOrigin-RevId: 501004802
 2023-01-10 08:43:51 -08:00
Jiuqiang TangandCopybara-Service c8b8d1fe6b Remove scripts for building MediaPipe Python 3.7 wheels. 
PiperOrigin-RevId: 496962729
 2022-12-21 11:12:27 -08:00
Jiuqiang TangandCopybara-Service 714a6e555b Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888. 
PiperOrigin-RevId: 496923491
 2022-12-21 08:07:53 -08:00
Jiuqiang TangandCopybara-Service 151e447614 Internal changes 
PiperOrigin-RevId: 496793199
 2022-12-20 17:52:17 -08:00
Jiuqiang TangandCopybara-Service 9067804005 Fix the missing logging component issue of mediapipe tasks core. 
PiperOrigin-RevId: 496548340
 2022-12-19 19:41:11 -08:00
Jiuqiang TangandCopybara-Service 7ce4bb72d4 Replace numpy.float with the builtin float type as numpy removes its own float type in v1.24. 
PiperOrigin-RevId: 496412858
 2022-12-19 09:02:51 -08:00
Jiuqiang TangandCopybara-Service 6bf5648430 Fix the documentation of the constructor of Image and ImageFrame Python classes. 
PiperOrigin-RevId: 495739875
 2022-12-15 17:42:23 -08:00
Jiuqiang TangandCopybara-Service fd50b6aa2f Add a new python unit test to test creating mediapipe Image from cvmat. 
PiperOrigin-RevId: 495655719
 2022-12-15 11:54:51 -08:00
Jiuqiang TangandCopybara-Service 299aa03302 Internal change 
PiperOrigin-RevId: 495613573
 2022-12-15 09:24:31 -08:00
Jiuqiang TangandCopybara-Service 174f2869a3 Internal changes 
PiperOrigin-RevId: 495322170
 2022-12-14 08:33:45 -08:00
Jiuqiang TangandCopybara-Service 78597c5b37 Internal changes. 
PiperOrigin-RevId: 495038477
 2022-12-13 09:08:15 -08:00
Jiuqiang TangandCopybara-Service 453d67de92 Add MergeDetectionsToVectorCalculator. 
PiperOrigin-RevId: 494246359
 2022-12-09 13:12:57 -08:00
Jiuqiang TangandCopybara-Service 13f8fa5139 Retire the visibility group "//mediapipe/framework:mediapipe_internal" in the "mediapipe/calculators/tensor" dir. 
PiperOrigin-RevId: 493895834
 2022-12-08 08:03:47 -08:00
Jiuqiang TangandCopybara-Service ef1507ed5d Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493713823
 2022-12-07 14:45:49 -08:00
Jiuqiang TangandCopybara-Service 955f090f9f Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493687025
 2022-12-07 13:08:33 -08:00
Jiuqiang TangandCopybara-Service 3c0ddf16b4 Fix an incorrect model sanity check in the object detector graph. 
PiperOrigin-RevId: 493663592
 2022-12-07 11:38:54 -08:00
Jiuqiang TangandCopybara-Service 80c605459c Open up framework visibility. 
PiperOrigin-RevId: 493660013
 2022-12-07 11:26:16 -08:00
Jiuqiang TangandCopybara-Service 6deef1a5f1 Allow specifying tag_suffix in the templated CreateModelResources method. 
PiperOrigin-RevId: 493375701
 2022-12-06 12:10:06 -08:00
Jiuqiang TangandCopybara-Service c6e6f9e0b9 Fix aar breakage caused by missing "//mediapipe/tasks/cc/vision/image_segmenter/proto:segmenter_options_java_proto_lite". 
PiperOrigin-RevId: 493357585
 2022-12-06 11:08:01 -08:00
Jiuqiang TangandCopybara-Service fb0b96115f Open up mediapipe core calculators' visibility. 
PiperOrigin-RevId: 493314353
 2022-12-06 08:40:57 -08:00
Jiuqiang TangandCopybara-Service 1761cdcef4 Fix aar breakage caused by missing "//mediapipe/tasks/java/com/google/mediapipe/tasks/components/containers:normalized_landmark". 
PiperOrigin-RevId: 493204770
 2022-12-05 22:16:46 -08:00
Jiuqiang TangandCopybara-Service 1e76d47a71 Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms. 
PiperOrigin-RevId: 493141519
 2022-12-05 16:20:20 -08:00
Jiuqiang TangandCopybara-Service ead41132a8 Load model file content from model file path with the help of GetResourceContents in browsers. 
This can handle the model files that are provided via a custom ResourceProviderFn.

PiperOrigin-RevId: 492308453
 2022-12-01 15:03:57 -08:00
Jiuqiang TangandCopybara-Service af990c3da1 Open up the visibility of "//mediapipe/java/com/google/mediapipe/framework/image:image". 
PiperOrigin-RevId: 492308109
 2022-12-01 15:00:25 -08:00
Jiuqiang TangandCopybara-Service 3ee37800e2 Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference. 
PiperOrigin-RevId: 492205954
 2022-12-01 08:43:30 -08:00
Jiuqiang TangandCopybara-Service e7eee27c1c Remove the deleted library "mediapipe/tasks/java/com/google/mediapipe/tasks/components/processors:embedderoptions" from mediapipe_tasks_aar's android_library deps list. 
PiperOrigin-RevId: 492200061
 2022-12-01 08:17:12 -08:00
Jiuqiang TangandCopybara-Service 460aee7933 Make mediapipe_tasks_aar's android_library depend on "//third_party:androidx_annotation". 
PiperOrigin-RevId: 492092487
 2022-11-30 20:45:02 -08:00
Jiuqiang TangandCopybara-Service c8a413bb4e Open up mediapipe framework's visibility. 
PiperOrigin-RevId: 491672877
 2022-11-29 10:19:44 -08:00
Jiuqiang TangandCopybara-Service 1b594a0310 Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate. 
PiperOrigin-RevId: 489539740
 2022-11-18 12:44:55 -08:00
Jiuqiang TangandCopybara-Service e046982a3c Internal change 
PiperOrigin-RevId: 489484898
 2022-11-18 08:47:09 -08:00
Jiuqiang TangandCopybara-Service a94564540b Bump up the dependency library pybind11's version to 2.10.1. 
PiperOrigin-RevId: 488718815
 2022-11-15 11:51:20 -08:00
Jiuqiang TangandCopybara-Service 87dff8142c Fix a typo. 
PiperOrigin-RevId: 488519113
 2022-11-14 18:13:50 -08:00
Jiuqiang TangandCopybara-Service f16e63694e Build embedding tasks into tasks AARs. 
PiperOrigin-RevId: 488509942
 2022-11-14 17:18:12 -08:00
Jiuqiang TangandCopybara-Service 794f64db55 Fix the wrong path of "text_embedder_graph_options_java_proto_lite". 
PiperOrigin-RevId: 488490050
 2022-11-14 15:51:05 -08:00
Jiuqiang TangandCopybara-Service cce1751dbf Expose tasks components API in PyPI packages. 
PiperOrigin-RevId: 488487666
 2022-11-14 15:41:11 -08:00
Jiuqiang TangandCopybara-Service e714e656fe Update python documentation. 
PiperOrigin-RevId: 488482142
 2022-11-14 15:18:47 -08:00
Jiuqiang TangandCopybara-Service b4fba6fe61 MediaPipe Tasks AudioEmbedder Java API 
PiperOrigin-RevId: 488456442
 2022-11-14 13:42:55 -08:00
Jiuqiang TangandCopybara-Service b40b2ade14 Fix typos. 
PiperOrigin-RevId: 488416345
 2022-11-14 11:07:59 -08:00
Jiuqiang TangandCopybara-Service 4b5c3521af Dividing the timestamp by 1000 when returning a "none" result object from GestureRecognizer and HandLandmarker APIs. 
PiperOrigin-RevId: 488409077
 2022-11-14 10:44:20 -08:00
Jiuqiang TangandCopybara-Service 6c0ca947de MediaPipe Tasks Audio embedder C++ API. 
PiperOrigin-RevId: 488273381
 2022-11-13 23:10:23 -08:00
Jiuqiang TangandCopybara-Service 8aa59faaa4 Internal change 
PiperOrigin-RevId: 488193046
 2022-11-13 09:51:48 -08:00
Jiuqiang TangandCopybara-Service bf6c8a0b63 Expose ImageEmbedder APIs in PyPI packages. 
PiperOrigin-RevId: 488033833
 2022-11-12 04:35:22 -08:00
Jiuqiang TangandCopybara-Service ce292c2a49 Fix a typo. 
PiperOrigin-RevId: 487872120
 2022-11-11 11:20:14 -08:00
Jiuqiang TangandCopybara-Service f329e38dc1 Map the "com_github_glog_glog" dependency of "com_google_sentencepiece" to mediapipe's "com_github_glog_glog_no_gflags". 
PiperOrigin-RevId: 487727239
 2022-11-10 22:12:42 -08:00
Jiuqiang TangandCopybara-Service 849134cfce Copy metatdata_schema.fbs into PyPI packages. 
PiperOrigin-RevId: 487685505
 2022-11-10 17:48:48 -08:00
Jiuqiang TangandCopybara-Service b3ac1c1387 Changes to create MediaPipe Tasks Audio AAR. 
PiperOrigin-RevId: 487661296
 2022-11-10 15:55:33 -08:00
Jiuqiang TangandCopybara-Service d6ba5e4bbe Map the "com_github_glog_glog" dependency of "com_google_audio_tools" to mediapipe's "com_github_glog_glog_no_gflags". 
PiperOrigin-RevId: 487651038
 2022-11-10 15:11:57 -08:00
Jiuqiang TangandCopybara-Service bb5782ee2f Correct the timestamp in the vision tasks result objects. 
PiperOrigin-RevId: 487597999
 2022-11-10 11:46:16 -08:00
Jiuqiang TangandCopybara-Service da4d455d0c Implement MediaPipe Tasks AudioClassifier Java API. 
PiperOrigin-RevId: 487570148
 2022-11-10 10:10:03 -08:00
Jiuqiang TangandCopybara-Service 2ce3a9719e Remove the problematic packet release calls in OutputHandler::run. 
OutputHandler::run is installed as a MultiStreamCallback into the TaskRunner and it's invoked in the Graph::CallbackToJava() jni method.

In CallbackToJava(), the packets are removed in RemovePacket() calls after the multi stream callback is invoked. The current logic lets the MultiStreamCallback release the packets first and leaves null pointers to RemovePacket() to remove, which may cause the app crash. The fix is to remove the packet release calls in the MultiStreamCallback and always leave the packet release work to RemovePacket().

PiperOrigin-RevId: 487558809
 2022-11-10 09:27:35 -08:00
Jiuqiang TangandCopybara-Service 6f66a7fde4 Rename GestureRecognitionResult to GestureRecognizerResult. 
PiperOrigin-RevId: 487306292
 2022-11-09 11:49:29 -08:00
Jiuqiang TangandCopybara-Service 4e568a1c3d Expose HandLandmarker API in PyPI packages. 
PiperOrigin-RevId: 487294501
 2022-11-09 11:06:33 -08:00
Jiuqiang TangandCopybara-Service ff6ca706c6 Internal change 
PiperOrigin-RevId: 486994334
 2022-11-08 10:52:51 -08:00
Jiuqiang TangandCopybara-Service 5c8b95666a Update "test_create_from_options_fails_with_invalid_model_path" of all tasks python api tests. 
PiperOrigin-RevId: 486990017
 2022-11-08 10:36:24 -08:00
Jiuqiang TangandCopybara-Service b14178d305 Temporarily exclude "audio_classifier_graph" from "builtin_task_graphs" on Windows. 
PiperOrigin-RevId: 486806337
 2022-11-07 17:27:33 -08:00
Jiuqiang TangandCopybara-Service 571c0b1fef Expose MediaPipe Tasks Audio and Text APIs in MediaPipe PyPI packages. 
PiperOrigin-RevId: 486777537
 2022-11-07 15:17:57 -08:00
Jiuqiang TangandCopybara-Service 63a759accc Implement MediaPipe AudioClassifier Tasks Python API. Adjust the AudioClassifier Tasks C++ API to remove "sample_rate" from its options. 
PiperOrigin-RevId: 486763992
 2022-11-07 14:28:14 -08:00
Jiuqiang TangandCopybara-Service c02f3933d4 Temporarily exclude "text_classifier_graph" from "builtin_task_graphs" on Windows. 
PiperOrigin-RevId: 486700027
 2022-11-07 10:28:28 -08:00
Jiuqiang TangandCopybara-Service 9f4496db77 Fix typos 
PiperOrigin-RevId: 486698923
 2022-11-07 10:24:17 -08:00
Jiuqiang TangandCopybara-Service 17a2de8cf7 Rename TextClassificationResult to TextClassifierResult. 
PiperOrigin-RevId: 486685936
 2022-11-07 09:39:01 -08:00
Jiuqiang TangandCopybara-Service 9504c5e6a1 Add a create_from_array classmethod to the AudioData class. 
PiperOrigin-RevId: 486310154
 2022-11-05 00:09:30 -07:00
Jiuqiang TangandCopybara-Service 416f91180b Remove the use of designated initializers. 
PiperOrigin-RevId: 486261384
 2022-11-04 16:57:21 -07:00
Jiuqiang TangandCopybara-Service 35f635d8ff Add an argument to packet_creator.create_matrix to allow the input matrix to be transposed first. 
PiperOrigin-RevId: 486258078
 2022-11-04 16:39:32 -07:00
Jiuqiang TangandCopybara-Service c10ebe8476 Remove the use of designated initializers. 
PiperOrigin-RevId: 486215798
 2022-11-04 13:24:48 -07:00
Jiuqiang TangandCopybara-Service 66e591d4bc Remove the use of designated initializers. 
PiperOrigin-RevId: 486185274
 2022-11-04 11:15:20 -07:00
Jiuqiang TangandCopybara-Service 5fd3701cfd Expose ImageSegmenter and GestureRecognizer APIs in PyPI packages. 
PiperOrigin-RevId: 486176206
 2022-11-04 10:39:21 -07:00
Jiuqiang TangandCopybara-Service 57759aedaf Enable using tasks metadata components in MediaPipe PyPI packages. 
PiperOrigin-RevId: 486162986
 2022-11-04 09:49:13 -07:00
Jiuqiang TangandCopybara-Service 93a587a422 Make the python documentation clear to resolve https://github.com/google/mediapipe/issues/3805. 
PiperOrigin-RevId: 486149904
 2022-11-04 08:46:36 -07:00
Jiuqiang TangandCopybara-Service 5f5f50d8f7 Implement MediaPipe Tasks Python AudioData. 
PiperOrigin-RevId: 486147173
 2022-11-04 08:32:30 -07:00
Jiuqiang TangandCopybara-Service b472d8ff66 Add the missing __init__.py file. 
PiperOrigin-RevId: 485892501
 2022-11-03 09:24:12 -07:00
Jiuqiang TangandCopybara-Service ac6aa9ce10 Fix a bug in the AndroidPacketCreator's createImage method. 
PiperOrigin-RevId: 485716828
 2022-11-02 15:56:49 -07:00
Jiuqiang TangandCopybara-Service 01d87f0867 Expose MediaPipe Tasks in MediaPipe PyPI packages. 
PiperOrigin-RevId: 485690163
 2022-11-02 14:07:47 -07:00
Jiuqiang TangandCopybara-Service e4899c8207 MediaPipe Python audio base layer. 
PiperOrigin-RevId: 485329470
 2022-11-01 08:53:36 -07:00
Jiuqiang TangandCopybara-Service 86951e048d Remove the unused TaskRunner from the mediapipe tasks python code. 
PiperOrigin-RevId: 485181210
 2022-10-31 16:54:30 -07:00
Jiuqiang TangandCopybara-Service 4717ac298c Add EndLoopMatrixCalculator 
PiperOrigin-RevId: 485097386
 2022-10-31 11:08:21 -07:00
Jiuqiang TangandCopybara-Service e16be2e8fa Implement the initial version of TensorsToAudioCalculator that supports ifft and inverse hann windowing. 
PiperOrigin-RevId: 484605092
 2022-10-28 13:19:43 -07:00
Jiuqiang TangandCopybara-Service f4f8b11ffc Fix the comment. 
PiperOrigin-RevId: 484571254
 2022-10-28 10:57:13 -07:00
Jiuqiang TangandCopybara-Service f315e6dc58 Workaround to solve "-lphtread" linker error on Android. 
PiperOrigin-RevId: 484285361
 2022-10-27 10:16:32 -07:00
Jiuqiang TangandCopybara-Service a941c5cdd1 Create MediaPipe "tasks-text" AAR. 
PiperOrigin-RevId: 484004494
 2022-10-26 10:18:22 -07:00
Jiuqiang TangandCopybara-Service 2cf9523468 Fix the java_package name. 
PiperOrigin-RevId: 483428848
 2022-10-24 10:55:16 -07:00
Jiuqiang TangandCopybara-Service de93d06f87 Implement build rules and targets to create MediaPipe Tasks AARs 
PiperOrigin-RevId: 483297891
 2022-10-24 00:45:32 -07:00
Jiuqiang TangandCopybara-Service abed54ea30 Rename the mediapipe java image container from Image to MPImage. 
PiperOrigin-RevId: 482933122
 2022-10-21 18:17:35 -07:00
Jiuqiang TangandCopybara-Service e1a9615e1a Add "alwayslink = 1" to "universal_sentence_encoder_preprocessor_calculator". 
PiperOrigin-RevId: 482864252
 2022-10-21 12:48:36 -07:00
Jiuqiang TangandCopybara-Service ed938a9214 Replace the usage of InvalidProtocolBufferException with IOException. 
PiperOrigin-RevId: 482844446
 2022-10-21 11:30:28 -07:00
Jiuqiang TangandCopybara-Service 2def7c8203 Add ".proto" suffix to gesture recognizer and object detector proto java package name. This aligns with the convention of image classifier and tasks core protos. 
PiperOrigin-RevId: 481451842
 2022-10-16 03:43:21 -07:00